-- Logs begin at Wed 2022-05-25 07:23:15 UTC, end at Wed 2022-05-25 08:23:43 UTC. -- May 25 07:55:06.733997 dv-osbrick-830800-13-ceph systemd[1]: Starting Devstack devstack@keystone.service... May 25 07:55:06.743614 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 07:55:06 2022] *** May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: nodename: dv-osbrick-830800-13-ceph May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: machine: x86_64 May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: clock source: unix May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: pcre jit disabled May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: detected number of CPU cores: 4 May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: current working directory: / May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: detected binary path: /usr/bin/uwsgi-core May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: your processes number limit is 47680 May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: your memory page size is 4096 bytes May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: detected max file descriptor number: 2048 May 25 07:55:06.745688 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: lock engine: pthread robust mutexes May 25 07:55:06.746435 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: thunder lock: enabled May 25 07:55:06.746435 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 25 07:55:06.746435 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 07:55:06.795538 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: Python main interpreter initialized at 0x55d88c6049c0 May 25 07:55:06.795538 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: python threads support enabled May 25 07:55:06.795538 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: your server socket listen backlog is limited to 100 connections May 25 07:55:06.795538 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: your mercy for graceful operations on workers is 90 seconds May 25 07:55:06.795930 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: mapped 403077 bytes (393 KB) for 2 cores May 25 07:55:06.796000 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: *** Operational MODE: preforking *** May 25 07:55:06.796260 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: *** uWSGI is running in multiple interpreter mode *** May 25 07:55:06.796260 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: spawned uWSGI master process (pid: 87035) May 25 07:55:06.796460 dv-osbrick-830800-13-ceph systemd[1]: Started Devstack devstack@keystone.service. May 25 07:55:06.804050 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: spawned uWSGI worker 1 (pid: 87084, cores: 1) May 25 07:55:06.804050 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: spawned uWSGI worker 2 (pid: 87085, cores: 1) May 25 07:55:06.804050 dv-osbrick-830800-13-ceph devstack@keystone.service[87035]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 07:55:12.653128 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:55:12.653128 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: from cryptography.utils import int_from_bytes May 25 07:55:12.653923 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:55:12.653923 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: from cryptography.utils import int_from_bytes May 25 07:55:12.654325 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:55:12.654325 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: from cryptography.utils import int_from_bytes May 25 07:55:12.654436 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:55:12.654436 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: from cryptography.utils import int_from_bytes May 25 07:55:12.702370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 07:55:12.702536 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 07:55:12.702622 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 07:55:12.702711 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 07:55:12.702795 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] command line args: [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 07:55:12.702872 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] command line args: [] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 07:55:12.702997 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 07:55:12.703664 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 07:55:12.703751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ================================================================================ {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 07:55:12.703829 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ================================================================================ {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 07:55:12.703963 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] admin_token = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.704091 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] admin_token = **** {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.704237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] config_dir = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.704366 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] config_dir = [] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.704444 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.704557 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.704648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] config_source = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.704744 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] config_source = [] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.704828 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] debug = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.704926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] debug = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.705010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.705243 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.705371 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.705475 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.705577 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.705685 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.705788 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.705900 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.706003 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.706107 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.706210 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.706318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] list_limit = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.706428 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_config_append = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.706530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] log_config_append = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.706633 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.706736 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.706839 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_dir = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.706950 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] log_dir = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.707053 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_file = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.707162 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] log_file = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.707242 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.707357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.707431 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.707553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.707635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.707755 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.707831 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.707951 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.708033 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.708114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.708240 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.708315 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.708441 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.708517 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.708632 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.708715 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.708832 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.708906 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.709020 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.709126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.709319 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.709465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.709548 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.709706 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.709785 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.709961 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.710050 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.710215 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.710293 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.710497 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.710766 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.710950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] publish_errors = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.711068 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.711167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] publish_errors = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.711269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.711372 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.711450 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.711559 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.711641 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.711769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.711854 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.712025 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.712107 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.712280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] standard_threads = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.712359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.712517 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.712605 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] standard_threads = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.712751 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.712827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.712927 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.713009 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.713089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] use_journal = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.713167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.713266 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] use_json = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.713343 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] use_journal = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.713440 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] use_stderr = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.713527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] use_json = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.713605 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] use_syslog = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.713676 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] use_stderr = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.713807 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] use_syslog = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.713886 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.714038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:55:12.714126 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.714299 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.714377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.714543 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.714621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.714784 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.714872 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.715037 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.715121 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.715277 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.715362 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.715517 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.715718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.715804 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.715881 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.715987 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.716086 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.716261 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.716359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.716513 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.716598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.716747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.716864 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.716985 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.717071 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.717222 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.717300 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.717464 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.717542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.717716 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.717801 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.717956 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.718034 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.718195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.718272 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.718458 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.718543 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.719270 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.719362 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.719511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.719587 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.719752 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.719837 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.720012 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.720090 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.720292 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.720370 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.720545 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.720635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.720782 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.720887 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.721015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.721093 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.721246 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.721333 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.721480 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.721557 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.721716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.721793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.721967 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.722046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.722198 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.722276 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.722431 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.722509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.722664 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.722741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.722916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.722996 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.723152 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.723234 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.723400 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.723478 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.723630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.723710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.723870 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.723949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.724107 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.724206 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.724370 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.724449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.724601 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.724684 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.724834 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.725066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.725149 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.725300 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.725377 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.725539 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.725618 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.725769 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.725853 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.726007 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.726085 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.726238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.726318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.726468 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.726544 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.726704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.726789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.726939 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.727092 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.727222 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.727303 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.727397 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.727482 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.727638 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.727719 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.727874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.727953 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.728111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.728219 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.728369 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.728448 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.728600 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.728686 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.728830 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.728908 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.729075 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.729162 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.729312 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.729398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.729539 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.729626 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.729777 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.729865 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.730021 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.730100 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.730271 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.730361 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.730507 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.730586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.730743 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.730831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.730975 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.731054 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.731236 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.731316 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.731474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.731554 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.731717 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.731795 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.731956 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.732044 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.732214 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.732296 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.732452 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.732531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.732692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.732783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.732927 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.733007 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.733166 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.733247 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.733410 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.733587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.733666 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.733737 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.733862 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.733942 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.734098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.734186 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.734360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.734447 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.734599 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.734681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.734837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.734924 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.735089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.735167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.735332 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.735411 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.735568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.735654 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.735809 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.735887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.736044 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.736151 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.736304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.736400 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.736542 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.736634 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.736771 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.736850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.737001 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.737087 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.737232 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.737322 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.737462 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.737545 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.737690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.737775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.737921 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.738007 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.738160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.738238 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.738397 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.738475 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.738636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.738723 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.738881 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.738960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.739144 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.739248 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.739368 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.739497 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.739603 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.external = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.739683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.739837 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.739915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] auth.external = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.740086 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.740238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.740385 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.740479 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.740618 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.password = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.740699 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.740850 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] auth.token = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.740929 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] auth.password = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.741087 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] auth.token = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.741168 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.741322 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.741401 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.741560 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.741646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.741812 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.742133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.742219 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.742292 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.742363 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.742506 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.742595 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.742742 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.742822 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.742978 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] credential.caching = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.743057 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.743226 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.743314 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.743475 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.743556 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.743722 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.743801 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.743961 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.744048 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.744227 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.744308 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.744467 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.744554 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.744733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.744820 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.744989 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.745070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.745230 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.745319 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.745480 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.745570 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.745767 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.745836 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.746023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.746092 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.746284 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.746370 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.746529 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.746618 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.746787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.746865 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.747023 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.747111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] federation.caching = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.747265 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.747344 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.747515 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.747593 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.747764 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.747917 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.747993 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.748064 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.748256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.748341 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.748497 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.748585 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.748751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.748831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.748989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.749077 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.749244 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.749331 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.749484 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.749564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.749733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.749811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.750039 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.750126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.caching = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.750294 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.750376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.750545 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.750625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.750785 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.750877 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.751023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.751103 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.751271 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.751351 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.751505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.751587 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.751746 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.751825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.751995 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.752074 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.752272 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.752356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.752506 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.752586 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.752740 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.752825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.752970 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.753050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.753216 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.753295 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.753462 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.753541 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.753710 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.753798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.753967 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.754048 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.754212 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.754293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.754483 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.754565 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.754723 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.754802 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.754958 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.755037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.755190 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.755277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.755426 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.755513 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.755658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.755737 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.755891 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.755971 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.756200 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.756285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.756393 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.756472 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.756640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.756721 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.756872 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.756960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.757120 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.757199 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.757366 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.757446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.757601 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.757679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.757845 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.757923 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.758093 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.758174 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.758321 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.758400 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.758561 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.758640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.758787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.758873 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.759024 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.759104 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.759257 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.759336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.759497 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.759577 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.759730 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.759809 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.759967 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.760045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.760237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.760319 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.760488 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.760568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.760720 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.760799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.760947 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.761028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.761196 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.761282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.761438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.761518 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.761673 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.761754 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.761905 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.761984 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.762141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.762221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.762373 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.762454 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.762615 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.762694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.762885 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.762965 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.763116 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.763196 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.763366 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.763446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.763615 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.763701 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.763857 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.763936 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.764092 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.764208 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.764345 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.764437 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.764581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.764661 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.764814 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.764892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.765051 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.765143 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.765278 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.765357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.766058 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.766145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.766310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.766398 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.766560 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.766639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.766812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.766890 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.767059 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.767397 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.767549 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.767629 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.767800 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.767878 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.768034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.768143 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.768296 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.768377 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.768533 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.768613 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.768766 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.768858 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.769012 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.769092 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.769259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.769338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.769498 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.769584 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.769751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.769830 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.769983 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.770062 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.770225 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.770311 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.770461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.770542 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.770697 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.770776 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.770929 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.771016 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.771178 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.771257 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.771418 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.771496 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.771650 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.771802 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.771880 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.771950 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.772111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.772237 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] resource.caching = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.772385 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.772477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.772636 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.772715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.772869 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.772948 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.773120 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.773208 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.773371 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.773451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.773607 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.773685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.773851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.773938 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.774089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.774169 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.774330 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.774409 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.774563 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] role.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.774650 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] role.caching = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.774812 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] role.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.774892 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] role.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.775040 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.775119 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.775290 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.775377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.775536 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.775622 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.775788 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.775867 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.776046 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.776155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.776321 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.776401 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.776569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.776649 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.776837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.776921 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.777054 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.777134 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.777287 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.777367 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.777538 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.777618 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.777788 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.777867 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.778035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.778115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.778286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.778699 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.778830 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.778932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.779132 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.779244 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.779376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.779485 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.779631 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.779792 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.779900 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.779999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.780107 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.780294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.780395 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.780494 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.780613 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.780721 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.780871 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.780981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.781145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.781783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.781913 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.782019 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.782149 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.782266 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.782366 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.782464 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.782601 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.782722 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.782855 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.782964 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.783117 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.783230 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.783355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.783469 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.783594 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.783701 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.783828 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.783934 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] token.caching = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.784060 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.784176 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.784323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.784405 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.784561 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.784641 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.784811 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.784898 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.785049 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.785129 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.785288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.785368 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.785539 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.785627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.785773 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.785851 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.786029 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.786150 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.786260 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.786352 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.786510 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.786593 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.786748 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.786830 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.787001 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.787090 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.787251 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.787332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.787489 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.787568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.787736 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.787826 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.787969 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.788050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.788238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.788324 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.connection = **** {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.788542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.788635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.788808 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.788897 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.connection = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.789056 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.789146 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.789305 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.789386 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.789545 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.789624 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.789858 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.789995 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.790073 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.790144 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.790249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.790329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.790490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.790572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.790728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.790808 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.790972 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.791051 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.791210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.791290 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.791452 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.791531 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.791690 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.791769 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.791938 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.792021 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.792197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.792279 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.792455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.792544 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.792669 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.792754 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.792827 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87084) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 07:55:12.792898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.793131 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:55:12.793304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87085) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 07:55:12.823629 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.823798 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.823866 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.823940 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.824068 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.824198 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.833372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.833474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.861821 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.862050 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.862171 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.862329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.916047 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.916783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.967270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.967484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.969607 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:12.969845 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.034422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.034643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.034797 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.034888 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.035034 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.035120 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.035260 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.035355 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.035480 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.035564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.035696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.035914 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.060654 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.060877 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.061102 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.061340 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.061541 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.061762 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.061971 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.062056 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.062265 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.063039 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.063263 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.063483 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.063698 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.063913 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.073907 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.074500 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.087209 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.087474 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.087661 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.087752 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.087883 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.087969 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.088102 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.088215 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.088338 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.088432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.088551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87085) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.088645 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.088775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.088991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87084) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 25 07:55:13.106121 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.106336 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 07:55:13.106511 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.106675 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.106760 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 07:55:13.106877 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 07:55:13.107051 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.107135 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.107257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 25 07:55:13.107388 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.107528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.107793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.107874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.108086 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.108348 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.108612 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.119412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.119685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.119948 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.120046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.120255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.120342 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.120587 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.120870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.128335 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.129038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.131701 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.131974 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.132281 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.132457 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.132571 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.132741 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.132852 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.133020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.133111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.133307 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.133390 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.133595 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.133676 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.133858 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.133948 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.134126 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.134206 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.134393 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.134493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.134660 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.134932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.135200 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.161472 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.162368 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.163071 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.163347 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.163987 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.164295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.168666 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.168898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.169176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.169578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.169860 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.170145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.177083 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.177364 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.178124 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.178406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.181827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.182115 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.182394 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.182673 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.182896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.182981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.183184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.183268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.183459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.183542 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.183726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.183807 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.184005 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.184309 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.184584 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.184859 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.202432 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.202708 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.203597 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.203875 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.207364 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.208473 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.211016 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.211307 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.212138 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.212437 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.216287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.217458 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.220556 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.221732 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.224178 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.224475 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.224757 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.225048 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.225332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.225417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.225626 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.225711 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.225935 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.226221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.226517 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.226821 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.245063 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.245343 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.245610 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.245872 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.246334 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.246619 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.246895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.247161 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.253865 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.255172 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.255569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.255840 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.256920 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.257198 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.258894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.259173 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.259463 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.259759 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.260178 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.260291 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.260535 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.260818 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.261111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.261515 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.273642 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.273921 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.274202 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.274488 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.274768 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.275050 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.275182 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.275333 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.275464 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.275753 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.276036 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.276349 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.276627 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.276929 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.293868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.295351 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.299227 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.299340 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.302591 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.302716 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.304307 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.304396 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.305930 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.306024 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.307507 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.307609 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.307802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.307888 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.315139 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.315239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.316766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.316861 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.319968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.320059 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.320280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.320367 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.320573 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.320662 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.320850 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.320944 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.330001 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.330107 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.330288 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.330374 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.330567 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.330661 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.338422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87085) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.338521 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=87084) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 25 07:55:13.338696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.338781 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.338975 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.339058 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.339244 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.339328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.339511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.339595 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.339778 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.339871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.340055 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.340165 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.340369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.340517 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.340623 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.340706 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.340897 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.340980 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.341261 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.341351 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.341523 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.341605 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.341802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.341883 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.342059 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87085) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.342145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87084) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 25 07:55:13.380902 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d88c6049c0 pid: 87084 (default app) May 25 07:55:13.381017 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55d88c6049c0 pid: 87085 (default app) May 25 07:55:13.384348 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c61567-f167-49a9-b508-7f7cd0eecef6 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:13.384643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c61567-f167-49a9-b508-7f7cd0eecef6 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:13.384924 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c61567-f167-49a9-b508-7f7cd0eecef6 None None] PATH_INFO: `/v3` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:13.389131 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Wed May 25 07:55:13 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:21.563298 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15fd9-e36a-4517-b4fc-d7b034d72ce8 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:21.563912 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15fd9-e36a-4517-b4fc-d7b034d72ce8 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:21.563912 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e15fd9-e36a-4517-b4fc-d7b034d72ce8 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:21.568393 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:21 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:55:21.574445 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1140b0-39ed-4691-96e8-529a1cf9ff57 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:21.574986 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1140b0-39ed-4691-96e8-529a1cf9ff57 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:21.574986 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1140b0-39ed-4691-96e8-529a1cf9ff57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:21.648321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: INFO dbcounter [None req-bb1140b0-39ed-4691-96e8-529a1cf9ff57 None None] Registered counter for database keystone May 25 07:55:21.671445 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG oslo_db.sqlalchemy.engines [None req-bb1140b0-39ed-4691-96e8-529a1cf9ff57 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87084) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:55:21.678140 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writer thread running {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:55:21.966571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG passlib.handlers.bcrypt [None req-bb1140b0-39ed-4691-96e8-529a1cf9ff57 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87084) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 07:55:21.967001 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG passlib.handlers.bcrypt [None req-bb1140b0-39ed-4691-96e8-529a1cf9ff57 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87084) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 07:55:22.024692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-bb1140b0-39ed-4691-96e8-529a1cf9ff57 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:22.026328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-bb1140b0-39ed-4691-96e8-529a1cf9ff57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:22.150738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:21 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 577 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 07:55:22.298090 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e15fd9-e36a-4517-b4fc-d7b034d72ce8 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:22.370949 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: INFO dbcounter [None req-59e15fd9-e36a-4517-b4fc-d7b034d72ce8 None None] Registered counter for database keystone May 25 07:55:22.390717 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG oslo_db.sqlalchemy.engines [None req-59e15fd9-e36a-4517-b4fc-d7b034d72ce8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87085) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:55:22.397524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writer thread running {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:55:22.517997 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e15fd9-e36a-4517-b4fc-d7b034d72ce8 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:22.522282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8bd3b0-d7e0-4919-affc-33ffd4b0d7ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:22.522952 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bd3b0-d7e0-4919-affc-33ffd4b0d7ef admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:22.523238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bd3b0-d7e0-4919-affc-33ffd4b0d7ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:22.523519 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8bd3b0-d7e0-4919-affc-33ffd4b0d7ef admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:22.532073 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bd3b0-d7e0-4919-affc-33ffd4b0d7ef admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:22.685732 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6f8bd3b0-d7e0-4919-affc-33ffd4b0d7ef admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 07:55:22.686383 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8bd3b0-d7e0-4919-affc-33ffd4b0d7ef admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:22.697066 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Wed May 25 07:55:22 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 25 07:55:22.703092 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1140b0-39ed-4691-96e8-529a1cf9ff57 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:22.717428 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1140b0-39ed-4691-96e8-529a1cf9ff57 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:22.721977 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a235dff-8226-45e4-8992-41d2b63cfb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:22.723092 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a235dff-8226-45e4-8992-41d2b63cfb58 admin admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:22.723381 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a235dff-8226-45e4-8992-41d2b63cfb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:22.723661 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a235dff-8226-45e4-8992-41d2b63cfb58 admin admin] PATH_INFO: `/v3/projects/93a049a9852946a29f77e99f63516cc1` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:22.725209 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a235dff-8226-45e4-8992-41d2b63cfb58 admin admin] RBAC: Authorizing `identity:get_project(project_id=93a049a9852946a29f77e99f63516cc1)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:22.778465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: WARNING keystone.common.rbac_enforcer.enforcer [None req-2a235dff-8226-45e4-8992-41d2b63cfb58 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 25 07:55:22.778735 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a235dff-8226-45e4-8992-41d2b63cfb58 admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:22.784149 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Wed May 25 07:55:22 2022] GET /identity/v3/projects/93a049a9852946a29f77e99f63516cc1 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:25.064717 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3f7b6-ecbd-4851-b91f-ce63e2c18c59 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:25.065294 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3f7b6-ecbd-4851-b91f-ce63e2c18c59 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:25.065392 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea3f7b6-ecbd-4851-b91f-ce63e2c18c59 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:25.069798 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:25.075865 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886403-b5ee-468a-99fe-604cd58d4ce6 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:25.076380 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886403-b5ee-468a-99fe-604cd58d4ce6 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:25.076485 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9886403-b5ee-468a-99fe-604cd58d4ce6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:25.095733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-d9886403-b5ee-468a-99fe-604cd58d4ce6 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:25.097327 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-d9886403-b5ee-468a-99fe-604cd58d4ce6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:25.105349 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:25 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 25 07:55:25.129832 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3f7b6-ecbd-4851-b91f-ce63e2c18c59 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:25.142876 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea3f7b6-ecbd-4851-b91f-ce63e2c18c59 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:25.147218 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9d34be-0981-4dba-b385-828ab1cd814d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:25.147856 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d34be-0981-4dba-b385-828ab1cd814d admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:25.148171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d34be-0981-4dba-b385-828ab1cd814d admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:25.148456 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9d34be-0981-4dba-b385-828ab1cd814d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:25.156272 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d34be-0981-4dba-b385-828ab1cd814d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:25.158054 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9d34be-0981-4dba-b385-828ab1cd814d admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:25.166886 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Wed May 25 07:55:25 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 25 07:55:25.174062 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9886403-b5ee-468a-99fe-604cd58d4ce6 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:25.183741 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9886403-b5ee-468a-99fe-604cd58d4ce6 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:25.188801 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e136536b-bc8f-4da1-8231-397dc1d0d68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:25.189670 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136536b-bc8f-4da1-8231-397dc1d0d68a admin admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:25.189960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136536b-bc8f-4da1-8231-397dc1d0d68a admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:25.190239 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e136536b-bc8f-4da1-8231-397dc1d0d68a admin admin] PATH_INFO: `/v3/users/945bb5172fb64c3a9a54077b32240aed` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:25.193003 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136536b-bc8f-4da1-8231-397dc1d0d68a admin admin] RBAC: Authorizing `identity:get_user(user_id=945bb5172fb64c3a9a54077b32240aed)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:25.194856 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e136536b-bc8f-4da1-8231-397dc1d0d68a admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:25.196510 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Wed May 25 07:55:25 2022] GET /identity/v3/users/945bb5172fb64c3a9a54077b32240aed => generated 247 bytes in 23 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:27.521219 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d67fd8-9c47-41de-8495-fa43ce7fd6be None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:27.521771 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d67fd8-9c47-41de-8495-fa43ce7fd6be None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:27.521771 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d67fd8-9c47-41de-8495-fa43ce7fd6be None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:27.523138 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:27.528991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c461bf6-2148-42c8-9400-f2786b47ce74 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:27.529512 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c461bf6-2148-42c8-9400-f2786b47ce74 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:27.529607 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c461bf6-2148-42c8-9400-f2786b47ce74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:27.547960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-0c461bf6-2148-42c8-9400-f2786b47ce74 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:27.549186 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-0c461bf6-2148-42c8-9400-f2786b47ce74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:27.632612 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 6/11] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:55:27.643947 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480310fc-4e7b-4ebb-8b0f-b0cd257e1f90 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:27.644282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480310fc-4e7b-4ebb-8b0f-b0cd257e1f90 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:27.644563 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480310fc-4e7b-4ebb-8b0f-b0cd257e1f90 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:27.645905 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 6/12] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:27.651250 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471a4b5-b6b2-449c-9d8a-1c7365c07407 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:27.651550 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471a4b5-b6b2-449c-9d8a-1c7365c07407 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:27.651834 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e471a4b5-b6b2-449c-9d8a-1c7365c07407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:27.659137 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480310fc-4e7b-4ebb-8b0f-b0cd257e1f90 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:27.669618 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-e471a4b5-b6b2-449c-9d8a-1c7365c07407 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:27.670839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-e471a4b5-b6b2-449c-9d8a-1c7365c07407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:27.688133 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:27.742422 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:27.765595 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471a4b5-b6b2-449c-9d8a-1c7365c07407 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:27.807780 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480310fc-4e7b-4ebb-8b0f-b0cd257e1f90 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:27.842667 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671c0fd-c75d-441d-b132-5349df242a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:27.844088 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671c0fd-c75d-441d-b132-5349df242a5b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:27.844406 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671c0fd-c75d-441d-b132-5349df242a5b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:27.844684 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8671c0fd-c75d-441d-b132-5349df242a5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:27.856271 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8671c0fd-c75d-441d-b132-5349df242a5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-8671c0fd-c75d-441d-b132-5349df242a5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:27.867490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:27.868704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:27.869635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:27.869635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:27.869635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:27.869635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:27.869635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:27.869635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:27.869635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:27.869635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:27.869635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:27.869635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:27.869635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:55:27.869635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:55:27.869635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:55:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:55:27.870381 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e471a4b5-b6b2-449c-9d8a-1c7365c07407 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:27.876607 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671c0fd-c75d-441d-b132-5349df242a5b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:27.904807 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e90ff-5cd7-4c66-b5b3-efaa0791df3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:27.906352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e90ff-5cd7-4c66-b5b3-efaa0791df3f None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:27.906629 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e90ff-5cd7-4c66-b5b3-efaa0791df3f None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:27.906907 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e90ff-5cd7-4c66-b5b3-efaa0791df3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:27.915151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:27.932433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:27.981451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e90ff-5cd7-4c66-b5b3-efaa0791df3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:27.982950 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e90ff-5cd7-4c66-b5b3-efaa0791df3f None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:27.993734 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8671c0fd-c75d-441d-b132-5349df242a5b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:28.027433 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bae8e-6c6c-454e-ae42-57d5db2afd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:28.028104 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bae8e-6c6c-454e-ae42-57d5db2afd13 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:28.028419 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bae8e-6c6c-454e-ae42-57d5db2afd13 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:28.028697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491bae8e-6c6c-454e-ae42-57d5db2afd13 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:28.029451 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bae8e-6c6c-454e-ae42-57d5db2afd13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:28.029755 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bae8e-6c6c-454e-ae42-57d5db2afd13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:28.031697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491bae8e-6c6c-454e-ae42-57d5db2afd13 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:28.043926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:55:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:28.050036 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bae8e-6c6c-454e-ae42-57d5db2afd13 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:28.084503 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:55:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 07:55:28.089961 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e90ff-5cd7-4c66-b5b3-efaa0791df3f None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:28.142647 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:28.145876 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:28.152489 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491bae8e-6c6c-454e-ae42-57d5db2afd13 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:28.188458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b06880-b0b2-4bbf-8386-693ab1d7be08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:28.189335 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b06880-b0b2-4bbf-8386-693ab1d7be08 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:28.189619 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b06880-b0b2-4bbf-8386-693ab1d7be08 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:28.189893 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b06880-b0b2-4bbf-8386-693ab1d7be08 None admin] PATH_INFO: `/v3/users/945bb5172fb64c3a9a54077b32240aed` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:28.191531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b06880-b0b2-4bbf-8386-693ab1d7be08 None admin] RBAC: Authorizing `identity:get_user(user_id=945bb5172fb64c3a9a54077b32240aed)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:28.192323 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e90ff-5cd7-4c66-b5b3-efaa0791df3f None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:28.193026 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b06880-b0b2-4bbf-8386-693ab1d7be08 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:28.194674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:28 2022] GET /identity/v3/users/945bb5172fb64c3a9a54077b32240aed => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:28.200023 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b06880-b0b2-4bbf-8386-693ab1d7be08 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:28.226427 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04666541-8769-4b39-b864-9ceadf8f783b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:28.227215 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04666541-8769-4b39-b864-9ceadf8f783b None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:28.227498 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04666541-8769-4b39-b864-9ceadf8f783b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:28.227770 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04666541-8769-4b39-b864-9ceadf8f783b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:28.238291 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04666541-8769-4b39-b864-9ceadf8f783b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:28.239769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04666541-8769-4b39-b864-9ceadf8f783b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-04666541-8769-4b39-b864-9ceadf8f783b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:55:28.260566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:28.261611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:28.262610 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:55:28.262610 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:55:28.262610 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:55:28.262610 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:55:28.262610 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:55:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:55:28.269640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04666541-8769-4b39-b864-9ceadf8f783b None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:28.300843 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b06880-b0b2-4bbf-8386-693ab1d7be08 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:28.335011 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d0aa4-3667-4c16-8de4-c1eb50421e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:28.335733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d0aa4-3667-4c16-8de4-c1eb50421e13 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:28.336018 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d0aa4-3667-4c16-8de4-c1eb50421e13 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:28.336328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07d0aa4-3667-4c16-8de4-c1eb50421e13 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:28.337616 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d0aa4-3667-4c16-8de4-c1eb50421e13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:28.339077 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07d0aa4-3667-4c16-8de4-c1eb50421e13 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:28.340732 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:55:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:28.346468 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d0aa4-3667-4c16-8de4-c1eb50421e13 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:28.368141 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04666541-8769-4b39-b864-9ceadf8f783b None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:28.370444 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:28.378447 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:28.403339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a15814-7089-46b4-8fd4-9a8364d76fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:28.404013 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a15814-7089-46b4-8fd4-9a8364d76fb3 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:28.404325 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a15814-7089-46b4-8fd4-9a8364d76fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:28.404604 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a15814-7089-46b4-8fd4-9a8364d76fb3 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:28.405338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a15814-7089-46b4-8fd4-9a8364d76fb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:28.405726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a15814-7089-46b4-8fd4-9a8364d76fb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:28.407149 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a15814-7089-46b4-8fd4-9a8364d76fb3 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:28.426808 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:55:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:28.453298 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07d0aa4-3667-4c16-8de4-c1eb50421e13 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:28.493031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe7f51-cb2d-4d07-9c56-77aaf69614f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:28.493706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7f51-cb2d-4d07-9c56-77aaf69614f6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:28.493989 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7f51-cb2d-4d07-9c56-77aaf69614f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:28.494265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe7f51-cb2d-4d07-9c56-77aaf69614f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:28.495132 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe7f51-cb2d-4d07-9c56-77aaf69614f6 None admin] RBAC: Adding query filter params (role.id=5c1382efdc2e4eebaf5f15a4cdae58e0, scope.domain.id=default, user.id=945bb5172fb64c3a9a54077b32240aed) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:28.495448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe7f51-cb2d-4d07-9c56-77aaf69614f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:28.497031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe7f51-cb2d-4d07-9c56-77aaf69614f6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:28.507176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 11/21] 10.222.0.25 () {56 vars in 1322 bytes} [Wed May 25 07:55:28 2022] GET /identity/v3/role_assignments?user.id=945bb5172fb64c3a9a54077b32240aed&scope.domain.id=default&role.id=5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 233 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:31.199733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c58e8-d2f5-4326-9315-e1ef03de6268 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:31.200799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c58e8-d2f5-4326-9315-e1ef03de6268 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:31.201285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857c58e8-d2f5-4326-9315-e1ef03de6268 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:31.203813 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:31.213853 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500caaa-5b99-4b0c-8627-ac72e11bf0a1 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:31.214785 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500caaa-5b99-4b0c-8627-ac72e11bf0a1 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:31.215269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500caaa-5b99-4b0c-8627-ac72e11bf0a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:31.231918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG passlib.handlers.bcrypt [None req-6500caaa-5b99-4b0c-8627-ac72e11bf0a1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=87085) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 25 07:55:31.232737 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG passlib.handlers.bcrypt [None req-6500caaa-5b99-4b0c-8627-ac72e11bf0a1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87085) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 25 07:55:31.293256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-6500caaa-5b99-4b0c-8627-ac72e11bf0a1 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:31.295275 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-6500caaa-5b99-4b0c-8627-ac72e11bf0a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:31.408678 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 12/23] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:31.454200 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c58e8-d2f5-4326-9315-e1ef03de6268 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:31.473112 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd9f02-abd5-4f8d-ae85-eb549221d4f4 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:31.473733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd9f02-abd5-4f8d-ae85-eb549221d4f4 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:31.474213 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebd9f02-abd5-4f8d-ae85-eb549221d4f4 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:31.479021 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 13/24] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:31.485744 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fd528-5366-476a-9bd6-19ae95d6aa4d None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:31.486337 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fd528-5366-476a-9bd6-19ae95d6aa4d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:31.486833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4fd528-5366-476a-9bd6-19ae95d6aa4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:31.525542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-1a4fd528-5366-476a-9bd6-19ae95d6aa4d None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:31.527941 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-1a4fd528-5366-476a-9bd6-19ae95d6aa4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:31.580152 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:31.698927 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 14/25] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:55:31.704910 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857c58e8-d2f5-4326-9315-e1ef03de6268 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:31.737689 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fd528-5366-476a-9bd6-19ae95d6aa4d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:31.764857 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6c8545-d365-4060-beec-2f95ae3e59c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:31.765681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c8545-d365-4060-beec-2f95ae3e59c1 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:31.765968 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c8545-d365-4060-beec-2f95ae3e59c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:31.766252 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6c8545-d365-4060-beec-2f95ae3e59c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:31.784932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c8545-d365-4060-beec-2f95ae3e59c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:31.786475 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6c8545-d365-4060-beec-2f95ae3e59c1 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-8f6c8545-d365-4060-beec-2f95ae3e59c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:55:31.836472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:31.837979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:31.840371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:55:31.840371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:55:31.840371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:55:31.840371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:55:31.840371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 12/26] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:55:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:55:31.840371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f440a82-6a67-4ce3-aa1a-5574a0a115b1 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:31.840371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f440a82-6a67-4ce3-aa1a-5574a0a115b1 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:31.840371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f440a82-6a67-4ce3-aa1a-5574a0a115b1 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:31.841195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 13/27] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:31.851472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f440a82-6a67-4ce3-aa1a-5574a0a115b1 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:31.892517 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:31.987684 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4fd528-5366-476a-9bd6-19ae95d6aa4d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:32.092061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f440a82-6a67-4ce3-aa1a-5574a0a115b1 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:32.137612 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac6e81-4c43-47df-937d-c1e4e563d673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:32.138438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac6e81-4c43-47df-937d-c1e4e563d673 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:32.138727 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac6e81-4c43-47df-937d-c1e4e563d673 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:32.139012 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac6e81-4c43-47df-937d-c1e4e563d673 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:32.170901 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac6e81-4c43-47df-937d-c1e4e563d673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:32.179155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c33223-b6e6-4e16-8123-175e3a4c7727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:32.180984 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c33223-b6e6-4e16-8123-175e3a4c7727 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:32.181850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c33223-b6e6-4e16-8123-175e3a4c7727 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:32.182637 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c33223-b6e6-4e16-8123-175e3a4c7727 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:32.184471 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c33223-b6e6-4e16-8123-175e3a4c7727 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:32.196955 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c33223-b6e6-4e16-8123-175e3a4c7727 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:32.200150 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c33223-b6e6-4e16-8123-175e3a4c7727 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-07ac6e81-4c43-47df-937d-c1e4e563d673 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:32.215006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:32.217234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:32.219332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:32.219332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:32.219332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:32.219332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:32.219332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:32.219332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:32.219332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:32.219332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:32.219332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:32.219332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:32.219332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:55:32.219332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:55:32.231749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 15/28] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:55:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 487 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:55:32.234694 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078af03-95ad-442f-b29c-8e152b219714 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:32.235446 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078af03-95ad-442f-b29c-8e152b219714 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:32.236362 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3078af03-95ad-442f-b29c-8e152b219714 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:32.254097 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 14/29] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:55:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:32.254581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c33223-b6e6-4e16-8123-175e3a4c7727 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:32.273973 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-3078af03-95ad-442f-b29c-8e152b219714 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:32.282930 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-3078af03-95ad-442f-b29c-8e152b219714 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:32.320508 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:32.423231 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:32.459617 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c33223-b6e6-4e16-8123-175e3a4c7727 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:32.506063 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1792b4ef-d64d-4930-8490-608090acc554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:32.506697 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792b4ef-d64d-4930-8490-608090acc554 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:32.506990 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792b4ef-d64d-4930-8490-608090acc554 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:32.507690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 16/30] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:32.507844 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1792b4ef-d64d-4930-8490-608090acc554 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:32.508085 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792b4ef-d64d-4930-8490-608090acc554 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:32.508510 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792b4ef-d64d-4930-8490-608090acc554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:32.508646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078af03-95ad-442f-b29c-8e152b219714 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:32.509794 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1792b4ef-d64d-4930-8490-608090acc554 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:32.527137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 15/31] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:55:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:32.528402 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869092-1d95-478e-89a2-85c482401b56 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:32.528693 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869092-1d95-478e-89a2-85c482401b56 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:32.528976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d869092-1d95-478e-89a2-85c482401b56 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:32.530778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 16/32] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:32.531612 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d869092-1d95-478e-89a2-85c482401b56 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:32.648335 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3078af03-95ad-442f-b29c-8e152b219714 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:32.696269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3a06f7-455b-4bae-aa6f-32ac86cb292b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:32.696950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a06f7-455b-4bae-aa6f-32ac86cb292b None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:32.697531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a06f7-455b-4bae-aa6f-32ac86cb292b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:32.697816 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3a06f7-455b-4bae-aa6f-32ac86cb292b None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:32.698770 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a06f7-455b-4bae-aa6f-32ac86cb292b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:32.700513 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3a06f7-455b-4bae-aa6f-32ac86cb292b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:32.729677 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d869092-1d95-478e-89a2-85c482401b56 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:32.745395 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:32.778920 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec9428-ad44-4c7a-805e-4f755d826d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:32.780428 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9428-ad44-4c7a-805e-4f755d826d20 None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:32.781153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9428-ad44-4c7a-805e-4f755d826d20 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:32.781856 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bec9428-ad44-4c7a-805e-4f755d826d20 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:32.783467 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec9428-ad44-4c7a-805e-4f755d826d20 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:32.785291 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bec9428-ad44-4c7a-805e-4f755d826d20 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:32.800160 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:32.924520 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 17/33] 10.222.0.25 () {60 vars in 1141 bytes} [Wed May 25 07:55:32 2022] POST /identity/v3/projects => generated 301 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:55:32.924520 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094d462-32d4-48ee-bd76-52cfb942b852 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:32.924520 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094d462-32d4-48ee-bd76-52cfb942b852 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:32.925073 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 17/34] 10.222.0.25 () {60 vars in 1131 bytes} [Wed May 25 07:55:32 2022] POST /identity/v3/roles => generated 225 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:55:32.925073 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec9428-ad44-4c7a-805e-4f755d826d20 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:32.925307 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1094d462-32d4-48ee-bd76-52cfb942b852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:32.964367 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-1094d462-32d4-48ee-bd76-52cfb942b852 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:32.966096 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-1094d462-32d4-48ee-bd76-52cfb942b852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:33.059821 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 18/35] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:33.060921 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db28c16-0b8b-45fe-a3ac-90e0121eea3e None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:33.061222 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db28c16-0b8b-45fe-a3ac-90e0121eea3e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:33.062072 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db28c16-0b8b-45fe-a3ac-90e0121eea3e None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:33.063561 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 19/36] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:33.086306 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36119797-22ce-474d-aec3-fbfffeef90bc None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:33.086575 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36119797-22ce-474d-aec3-fbfffeef90bc None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:33.087068 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36119797-22ce-474d-aec3-fbfffeef90bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:33.114751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-36119797-22ce-474d-aec3-fbfffeef90bc None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:33.115999 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-36119797-22ce-474d-aec3-fbfffeef90bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:33.151101 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bec9428-ad44-4c7a-805e-4f755d826d20 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:33.204363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 20/37] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 25 07:55:33.205391 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36119797-22ce-474d-aec3-fbfffeef90bc None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:33.245076 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e4087-4dc4-43c3-ad22-5e5bbcbee71e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:33.246099 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e4087-4dc4-43c3-ad22-5e5bbcbee71e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:33.246256 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e4087-4dc4-43c3-ad22-5e5bbcbee71e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:33.246526 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e4087-4dc4-43c3-ad22-5e5bbcbee71e None admin] PATH_INFO: `/v3/users/945bb5172fb64c3a9a54077b32240aed` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:33.248349 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e4087-4dc4-43c3-ad22-5e5bbcbee71e None admin] RBAC: Authorizing `identity:get_user(user_id=945bb5172fb64c3a9a54077b32240aed)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:33.250591 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e4087-4dc4-43c3-ad22-5e5bbcbee71e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:33.252406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 18/38] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:32 2022] GET /identity/v3/users/945bb5172fb64c3a9a54077b32240aed => generated 247 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:33.258646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae8a7-e470-4713-8b33-461800bf34c0 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:33.259045 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae8a7-e470-4713-8b33-461800bf34c0 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:33.259292 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32eae8a7-e470-4713-8b33-461800bf34c0 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:33.265196 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 19/39] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:33.267209 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eae8a7-e470-4713-8b33-461800bf34c0 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:33.288392 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:33.360328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36119797-22ce-474d-aec3-fbfffeef90bc None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:33.375371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:33.412008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32eae8a7-e470-4713-8b33-461800bf34c0 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:33.419808 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73e0a91-b94b-4c67-ad91-5fc25f392fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:33.421515 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e0a91-b94b-4c67-ad91-5fc25f392fb6 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:33.422001 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e0a91-b94b-4c67-ad91-5fc25f392fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:33.422465 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73e0a91-b94b-4c67-ad91-5fc25f392fb6 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:33.423874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e0a91-b94b-4c67-ad91-5fc25f392fb6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:33.426668 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73e0a91-b94b-4c67-ad91-5fc25f392fb6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:33.447740 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a5046-2c97-4788-81e6-0037437f8f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:33.448538 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a5046-2c97-4788-81e6-0037437f8f66 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:33.448828 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a5046-2c97-4788-81e6-0037437f8f66 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:33.449110 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7a5046-2c97-4788-81e6-0037437f8f66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:33.449923 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 21/40] 10.222.0.25 () {60 vars in 1131 bytes} [Wed May 25 07:55:33 2022] POST /identity/v3/roles => generated 219 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:55:33.450632 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a5046-2c97-4788-81e6-0037437f8f66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:33.452274 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7a5046-2c97-4788-81e6-0037437f8f66 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:33.452566 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb69d5-a477-447d-a23e-faba9800def2 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:33.453095 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb69d5-a477-447d-a23e-faba9800def2 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:33.453610 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eb69d5-a477-447d-a23e-faba9800def2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:33.453956 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 20/41] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:55:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:33.459636 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a5046-2c97-4788-81e6-0037437f8f66 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:33.485692 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-64eb69d5-a477-447d-a23e-faba9800def2 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:33.487957 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-64eb69d5-a477-447d-a23e-faba9800def2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:33.579277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7a5046-2c97-4788-81e6-0037437f8f66 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:33.620345 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c23ce-2c72-43cf-aaae-fd69f3bc7da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:33.621083 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c23ce-2c72-43cf-aaae-fd69f3bc7da5 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:33.621563 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c23ce-2c72-43cf-aaae-fd69f3bc7da5 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:33.622063 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c23ce-2c72-43cf-aaae-fd69f3bc7da5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:33.623755 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c23ce-2c72-43cf-aaae-fd69f3bc7da5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:33.625371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c23ce-2c72-43cf-aaae-fd69f3bc7da5 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:33.626381 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 22/42] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:33.627849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb69d5-a477-447d-a23e-faba9800def2 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:33.629429 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 21/43] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:55:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:33.647525 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c23ce-2c72-43cf-aaae-fd69f3bc7da5 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:33.650676 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:33.725315 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:33.768756 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c23ce-2c72-43cf-aaae-fd69f3bc7da5 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:33.786247 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eb69d5-a477-447d-a23e-faba9800def2 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:33.804401 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f89b3-471d-48a4-9959-e3e5d60f32ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:33.805070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f89b3-471d-48a4-9959-e3e5d60f32ab None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:33.805356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f89b3-471d-48a4-9959-e3e5d60f32ab None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:33.805636 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8f89b3-471d-48a4-9959-e3e5d60f32ab None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:33.806368 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f89b3-471d-48a4-9959-e3e5d60f32ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:33.807850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8f89b3-471d-48a4-9959-e3e5d60f32ab None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:33.821454 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057060d4-6eed-4018-b683-c2d4978b271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:33.822558 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057060d4-6eed-4018-b683-c2d4978b271d None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:33.822936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057060d4-6eed-4018-b683-c2d4978b271d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:33.823313 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057060d4-6eed-4018-b683-c2d4978b271d None admin] PATH_INFO: `/v3/domains/default/users/945bb5172fb64c3a9a54077b32240aed/roles/5c1382efdc2e4eebaf5f15a4cdae58e0` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:33.826468 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057060d4-6eed-4018-b683-c2d4978b271d None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=945bb5172fb64c3a9a54077b32240aed, role_id=5c1382efdc2e4eebaf5f15a4cdae58e0)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:33.829033 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057060d4-6eed-4018-b683-c2d4978b271d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:33.837023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1141 bytes} [Wed May 25 07:55:33 2022] POST /identity/v3/projects => generated 312 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:55:33.837742 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f89b3-471d-48a4-9959-e3e5d60f32ab None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:33.849508 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 23/45] 10.222.0.25 () {58 vars in 1361 bytes} [Wed May 25 07:55:33 2022] PUT /identity/v3/domains/default/users/945bb5172fb64c3a9a54077b32240aed/roles/5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:55:33.928302 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:34.009218 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8f89b3-471d-48a4-9959-e3e5d60f32ab None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:34.055847 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e94376-d48d-4d87-9f33-f9ccca80f184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:34.056875 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e94376-d48d-4d87-9f33-f9ccca80f184 None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:34.057290 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e94376-d48d-4d87-9f33-f9ccca80f184 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:34.057715 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e94376-d48d-4d87-9f33-f9ccca80f184 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:34.058655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e94376-d48d-4d87-9f33-f9ccca80f184 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:34.060323 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e94376-d48d-4d87-9f33-f9ccca80f184 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:34.082189 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1131 bytes} [Wed May 25 07:55:33 2022] POST /identity/v3/roles => generated 223 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:55:36.275825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a6894-f739-41cd-ac10-55b89c82eaaa None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:36.276378 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a6894-f739-41cd-ac10-55b89c82eaaa None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:36.276704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a6894-f739-41cd-ac10-55b89c82eaaa None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:36.279113 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 24/47] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:36.285442 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce79db-0c4b-4f7b-90cb-9c3ed8e5299c None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:36.286013 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce79db-0c4b-4f7b-90cb-9c3ed8e5299c None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:36.286013 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ce79db-0c4b-4f7b-90cb-9c3ed8e5299c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:36.305843 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-c7ce79db-0c4b-4f7b-90cb-9c3ed8e5299c None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:36.308530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-c7ce79db-0c4b-4f7b-90cb-9c3ed8e5299c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:36.395482 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 24/48] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:55:36.422645 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a6894-f739-41cd-ac10-55b89c82eaaa None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:36.563738 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a6894-f739-41cd-ac10-55b89c82eaaa None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:36.575301 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:36.613734 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c3950-f036-43c5-87f8-c9c089bfd41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:36.615078 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c3950-f036-43c5-87f8-c9c089bfd41f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:36.615571 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c3950-f036-43c5-87f8-c9c089bfd41f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:36.616050 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c3950-f036-43c5-87f8-c9c089bfd41f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:36.635364 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c3950-f036-43c5-87f8-c9c089bfd41f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-d02c3950-f036-43c5-87f8-c9c089bfd41f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:36.649849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:36.650753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:36.651486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:36.651486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:36.651486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:36.651486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:36.651486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:36.651486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:36.651486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:36.651486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:36.651486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:36.651486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:36.651486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:55:36.651486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:55:36.652614 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 25/49] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:55:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:55:36.659200 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce79db-0c4b-4f7b-90cb-9c3ed8e5299c None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:36.719157 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:36.731906 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db485-2845-4e11-bf3a-9fec5bbf1e35 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:36.732837 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db485-2845-4e11-bf3a-9fec5bbf1e35 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:36.733129 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971db485-2845-4e11-bf3a-9fec5bbf1e35 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:36.735065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 26/50] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:55:36.740986 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55b534-8d6a-4ab0-9851-c91037c0417c None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:36.741285 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55b534-8d6a-4ab0-9851-c91037c0417c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:36.741561 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a55b534-8d6a-4ab0-9851-c91037c0417c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:36.760188 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-8a55b534-8d6a-4ab0-9851-c91037c0417c None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:36.761448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8a55b534-8d6a-4ab0-9851-c91037c0417c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:36.798137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ce79db-0c4b-4f7b-90cb-9c3ed8e5299c None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:36.842442 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36677fc-105b-49b7-a8d6-dc48b965c6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:36.843637 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36677fc-105b-49b7-a8d6-dc48b965c6e5 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:36.843926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36677fc-105b-49b7-a8d6-dc48b965c6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:36.844242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36677fc-105b-49b7-a8d6-dc48b965c6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:36.844798 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 27/51] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:55:36.845029 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36677fc-105b-49b7-a8d6-dc48b965c6e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:36.845351 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36677fc-105b-49b7-a8d6-dc48b965c6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:36.846888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36677fc-105b-49b7-a8d6-dc48b965c6e5 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:36.857130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 25/52] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:55:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:36.863545 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55b534-8d6a-4ab0-9851-c91037c0417c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:36.870296 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36677fc-105b-49b7-a8d6-dc48b965c6e5 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:36.986661 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:36.987510 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36677fc-105b-49b7-a8d6-dc48b965c6e5 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:36.991734 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a55b534-8d6a-4ab0-9851-c91037c0417c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:36.995591 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:37.028704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de58aa-4918-4cb8-9945-d5c6b1b387a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:37.029531 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de58aa-4918-4cb8-9945-d5c6b1b387a8 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:37.029820 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de58aa-4918-4cb8-9945-d5c6b1b387a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:37.030100 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88de58aa-4918-4cb8-9945-d5c6b1b387a8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:37.031351 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de58aa-4918-4cb8-9945-d5c6b1b387a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:37.032048 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5df3e-b909-4848-a861-d11b353deb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:37.032920 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88de58aa-4918-4cb8-9945-d5c6b1b387a8 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:37.033022 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5df3e-b909-4848-a861-d11b353deb6a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:37.033251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5df3e-b909-4848-a861-d11b353deb6a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:37.033536 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b5df3e-b909-4848-a861-d11b353deb6a None admin] PATH_INFO: `/v3/users/945bb5172fb64c3a9a54077b32240aed` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:37.034650 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 26/53] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:55:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:37.034872 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5df3e-b909-4848-a861-d11b353deb6a None admin] RBAC: Authorizing `identity:get_user(user_id=945bb5172fb64c3a9a54077b32240aed)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:37.036407 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b5df3e-b909-4848-a861-d11b353deb6a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:37.038141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 28/54] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:36 2022] GET /identity/v3/users/945bb5172fb64c3a9a54077b32240aed => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:37.040557 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de58aa-4918-4cb8-9945-d5c6b1b387a8 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:37.043465 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5df3e-b909-4848-a861-d11b353deb6a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:37.153391 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b5df3e-b909-4848-a861-d11b353deb6a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:37.164090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88de58aa-4918-4cb8-9945-d5c6b1b387a8 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:37.189847 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8ca84-1bd2-489a-8f36-22c0bbd8ab44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:37.190642 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8ca84-1bd2-489a-8f36-22c0bbd8ab44 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:37.190926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8ca84-1bd2-489a-8f36-22c0bbd8ab44 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:37.191201 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8ca84-1bd2-489a-8f36-22c0bbd8ab44 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:37.192433 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8ca84-1bd2-489a-8f36-22c0bbd8ab44 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:37.193886 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8ca84-1bd2-489a-8f36-22c0bbd8ab44 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:37.195505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 29/55] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:55:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:37.201260 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8ca84-1bd2-489a-8f36-22c0bbd8ab44 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:37.214109 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678a306-7b31-4bf0-b3e3-142666a7142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:37.215264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678a306-7b31-4bf0-b3e3-142666a7142a None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:37.215759 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678a306-7b31-4bf0-b3e3-142666a7142a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:37.216304 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678a306-7b31-4bf0-b3e3-142666a7142a None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:37.218190 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678a306-7b31-4bf0-b3e3-142666a7142a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:37.220931 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678a306-7b31-4bf0-b3e3-142666a7142a None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:37.237053 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:37.262377 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 27/56] 10.222.0.25 () {60 vars in 1140 bytes} [Wed May 25 07:55:37 2022] POST /identity/v3/projects => generated 298 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:55:37.310367 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8ca84-1bd2-489a-8f36-22c0bbd8ab44 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:37.348021 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9639fd6d-88e9-4285-b626-ad28801af56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:37.348747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639fd6d-88e9-4285-b626-ad28801af56c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:37.349034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639fd6d-88e9-4285-b626-ad28801af56c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:37.349313 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9639fd6d-88e9-4285-b626-ad28801af56c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:37.350197 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639fd6d-88e9-4285-b626-ad28801af56c None admin] RBAC: Adding query filter params (role.id=5c1382efdc2e4eebaf5f15a4cdae58e0, scope.domain.id=default, user.id=945bb5172fb64c3a9a54077b32240aed) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:37.350535 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639fd6d-88e9-4285-b626-ad28801af56c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:37.352037 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9639fd6d-88e9-4285-b626-ad28801af56c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:37.359335 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 30/57] 10.222.0.25 () {56 vars in 1322 bytes} [Wed May 25 07:55:37 2022] GET /identity/v3/role_assignments?user.id=945bb5172fb64c3a9a54077b32240aed&scope.domain.id=default&role.id=5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 530 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:39.556838 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be636b-2438-49cb-8152-86e185571347 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:39.557441 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be636b-2438-49cb-8152-86e185571347 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:39.557441 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be636b-2438-49cb-8152-86e185571347 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:39.558776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 28/58] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:39.564951 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b947a-88c0-4ea9-a17f-051b63685623 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:39.565434 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b947a-88c0-4ea9-a17f-051b63685623 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:39.565593 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964b947a-88c0-4ea9-a17f-051b63685623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:39.582536 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-964b947a-88c0-4ea9-a17f-051b63685623 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:39.583746 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-964b947a-88c0-4ea9-a17f-051b63685623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:39.653353 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 31/59] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:39.681017 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be636b-2438-49cb-8152-86e185571347 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:39.713488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:39.809229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be636b-2438-49cb-8152-86e185571347 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:39.850015 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffcbdd4c-db43-42f5-8ee8-d75111e30d51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:39.850851 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbdd4c-db43-42f5-8ee8-d75111e30d51 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:39.851143 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbdd4c-db43-42f5-8ee8-d75111e30d51 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:39.851454 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffcbdd4c-db43-42f5-8ee8-d75111e30d51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:39.852891 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbdd4c-db43-42f5-8ee8-d75111e30d51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:39.854436 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffcbdd4c-db43-42f5-8ee8-d75111e30d51 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:39.856250 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 29/60] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:55:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:39.862063 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b947a-88c0-4ea9-a17f-051b63685623 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:39.892902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:39.966722 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964b947a-88c0-4ea9-a17f-051b63685623 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:40.000424 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cf75a7-f6cd-48c0-a3d5-1b9776323f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:40.001089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf75a7-f6cd-48c0-a3d5-1b9776323f58 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:40.001376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf75a7-f6cd-48c0-a3d5-1b9776323f58 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:40.001655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cf75a7-f6cd-48c0-a3d5-1b9776323f58 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:40.002374 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf75a7-f6cd-48c0-a3d5-1b9776323f58 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:40.003834 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cf75a7-f6cd-48c0-a3d5-1b9776323f58 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:40.035744 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 32/61] 10.222.0.25 () {60 vars in 1132 bytes} [Wed May 25 07:55:39 2022] POST /identity/v3/users => generated 275 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:55:43.399283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b1a28-e233-40cb-af79-7a8d5d98acea None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:43.400207 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b1a28-e233-40cb-af79-7a8d5d98acea None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:43.400652 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985b1a28-e233-40cb-af79-7a8d5d98acea None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:43.402272 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 30/62] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:43.408466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656e320-d851-4822-8a63-62d3b2cb6856 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:43.409311 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656e320-d851-4822-8a63-62d3b2cb6856 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:43.409795 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8656e320-d851-4822-8a63-62d3b2cb6856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:43.431679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-8656e320-d851-4822-8a63-62d3b2cb6856 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:43.433195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8656e320-d851-4822-8a63-62d3b2cb6856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:43.529121 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 33/63] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:43.579789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b1a28-e233-40cb-af79-7a8d5d98acea None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:43.666582 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c5035-2734-410a-9492-d8b6c2b760d7 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:43.667224 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c5035-2734-410a-9492-d8b6c2b760d7 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:43.667707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c5035-2734-410a-9492-d8b6c2b760d7 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:43.669405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 34/64] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:55:43.675939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97f69-73fe-4630-b685-42ef35e8069b None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:43.676644 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97f69-73fe-4630-b685-42ef35e8069b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:43.677129 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d97f69-73fe-4630-b685-42ef35e8069b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:43.708944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-94d97f69-73fe-4630-b685-42ef35e8069b None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:43.712097 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-94d97f69-73fe-4630-b685-42ef35e8069b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:43.732503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:43.737611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:43.746212 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985b1a28-e233-40cb-af79-7a8d5d98acea None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:43.788404 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a06f2f-866d-4bf8-80c9-38a684dd827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:43.789528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a06f2f-866d-4bf8-80c9-38a684dd827b None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:43.789961 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a06f2f-866d-4bf8-80c9-38a684dd827b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:43.790385 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a06f2f-866d-4bf8-80c9-38a684dd827b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:43.801863 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 35/65] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:55:43.803651 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89294d1a-e1d3-4330-906a-20d3be629874 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:43.804150 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89294d1a-e1d3-4330-906a-20d3be629874 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:43.804606 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89294d1a-e1d3-4330-906a-20d3be629874 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:43.806109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 36/66] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:43.811936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b1d07-8139-4f8a-9d36-7b26e3961140 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:43.812360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a06f2f-866d-4bf8-80c9-38a684dd827b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:43.812831 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b1d07-8139-4f8a-9d36-7b26e3961140 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:43.813293 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b1d07-8139-4f8a-9d36-7b26e3961140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-b6a06f2f-866d-4bf8-80c9-38a684dd827b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:43.829837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:43.830776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:43.831574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:43.831574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:43.831574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:43.831574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:43.831574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:43.831574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:43.831574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:43.831574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:43.831574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:43.831574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:43.831574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:55:43.831574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:55:43.831574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 31/67] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:55:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:55:43.834194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-c80b1d07-8139-4f8a-9d36-7b26e3961140 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:43.835667 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-c80b1d07-8139-4f8a-9d36-7b26e3961140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:43.837772 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a06f2f-866d-4bf8-80c9-38a684dd827b None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:43.918535 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 37/68] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:43.928153 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b1d07-8139-4f8a-9d36-7b26e3961140 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:43.966232 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a06f2f-866d-4bf8-80c9-38a684dd827b None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:44.007914 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c5b21-9a26-4931-ba49-e5622e200bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:44.009003 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c5b21-9a26-4931-ba49-e5622e200bd4 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.009493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c5b21-9a26-4931-ba49-e5622e200bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.009995 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566c5b21-9a26-4931-ba49-e5622e200bd4 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.010994 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c5b21-9a26-4931-ba49-e5622e200bd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:44.011777 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c5b21-9a26-4931-ba49-e5622e200bd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:44.013510 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566c5b21-9a26-4931-ba49-e5622e200bd4 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:44.024020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 32/69] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:55:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:44.025344 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c5b21-9a26-4931-ba49-e5622e200bd4 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:44.040786 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:44.049196 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:44.071818 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80b1d07-8139-4f8a-9d36-7b26e3961140 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:44.111052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc11a3-d7a0-45a0-a73b-0de8f140777b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:44.112177 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc11a3-d7a0-45a0-a73b-0de8f140777b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.112571 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc11a3-d7a0-45a0-a73b-0de8f140777b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.112854 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc11a3-d7a0-45a0-a73b-0de8f140777b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.125770 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc11a3-d7a0-45a0-a73b-0de8f140777b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-31dc11a3-d7a0-45a0-a73b-0de8f140777b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:44.134176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:44.135105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:44.135851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:44.135851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:44.135851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:44.135851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:44.135851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:44.135851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:44.135851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:44.135851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:44.135851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:44.135851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:44.135851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:55:44.135851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:55:44.135851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 38/70] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:55:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:55:44.137110 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc11a3-d7a0-45a0-a73b-0de8f140777b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:44.151228 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566c5b21-9a26-4931-ba49-e5622e200bd4 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:44.189124 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e224b-e7a6-488a-8af2-2eb4fbf58241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:44.189873 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e224b-e7a6-488a-8af2-2eb4fbf58241 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.190163 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e224b-e7a6-488a-8af2-2eb4fbf58241 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.190618 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e224b-e7a6-488a-8af2-2eb4fbf58241 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.203632 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e224b-e7a6-488a-8af2-2eb4fbf58241 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-2b0e224b-e7a6-488a-8af2-2eb4fbf58241 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:44.211528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:44.212692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 33/71] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:55:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:55:44.218991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80eecc9-f551-467c-a558-758fa8741a9b None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.219672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80eecc9-f551-467c-a558-758fa8741a9b None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.219672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80eecc9-f551-467c-a558-758fa8741a9b None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.219672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 34/72] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:44.219672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80eecc9-f551-467c-a558-758fa8741a9b None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:44.262297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc11a3-d7a0-45a0-a73b-0de8f140777b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:44.300811 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0676a3e-6445-4951-b4c7-f4f58add1b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:44.302039 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0676a3e-6445-4951-b4c7-f4f58add1b61 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.302506 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0676a3e-6445-4951-b4c7-f4f58add1b61 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.302989 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0676a3e-6445-4951-b4c7-f4f58add1b61 None admin] PATH_INFO: `/v3/users/c037cea25a404f0783e6ef90b07a1769` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.305609 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:44.308880 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:44.321850 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0676a3e-6445-4951-b4c7-f4f58add1b61 None admin] RBAC: Authorizing `identity:get_user(user_id=c037cea25a404f0783e6ef90b07a1769)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:44.323350 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0676a3e-6445-4951-b4c7-f4f58add1b61 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:44.325160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 39/73] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:44 2022] GET /identity/v3/users/c037cea25a404f0783e6ef90b07a1769 => generated 275 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:44.325962 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0676a3e-6445-4951-b4c7-f4f58add1b61 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:44.341874 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80eecc9-f551-467c-a558-758fa8741a9b None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:44.378048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d9decc-da80-4ddb-81b1-15bd9802e03e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:44.378726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9decc-da80-4ddb-81b1-15bd9802e03e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.379012 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9decc-da80-4ddb-81b1-15bd9802e03e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.379291 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d9decc-da80-4ddb-81b1-15bd9802e03e None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.380040 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9decc-da80-4ddb-81b1-15bd9802e03e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:44.380390 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9decc-da80-4ddb-81b1-15bd9802e03e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:44.381780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d9decc-da80-4ddb-81b1-15bd9802e03e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:44.389958 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 35/74] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:55:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:44.391200 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71627881-5387-4a54-b8ad-f473f7452aff None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.391495 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71627881-5387-4a54-b8ad-f473f7452aff None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.392044 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71627881-5387-4a54-b8ad-f473f7452aff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.409258 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-71627881-5387-4a54-b8ad-f473f7452aff None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:44.410462 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-71627881-5387-4a54-b8ad-f473f7452aff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:44.432907 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0676a3e-6445-4951-b4c7-f4f58add1b61 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:44.471234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4122c5-33f6-4e26-aaa8-1deeae6fc81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:44.472499 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4122c5-33f6-4e26-aaa8-1deeae6fc81c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.472499 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4122c5-33f6-4e26-aaa8-1deeae6fc81c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.472499 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4122c5-33f6-4e26-aaa8-1deeae6fc81c None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.473188 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4122c5-33f6-4e26-aaa8-1deeae6fc81c None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:44.473505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4122c5-33f6-4e26-aaa8-1deeae6fc81c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:44.474968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4122c5-33f6-4e26-aaa8-1deeae6fc81c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:44.481049 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 36/75] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:44.483828 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71627881-5387-4a54-b8ad-f473f7452aff None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:44.491785 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 40/76] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:55:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:44.491785 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312a617-47f1-486d-af56-973481834ba9 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.491785 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312a617-47f1-486d-af56-973481834ba9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.491785 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e312a617-47f1-486d-af56-973481834ba9 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.492151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 41/77] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:44.496888 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312a617-47f1-486d-af56-973481834ba9 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:44.557741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:44.558872 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:44.594287 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71627881-5387-4a54-b8ad-f473f7452aff None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:44.606631 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e312a617-47f1-486d-af56-973481834ba9 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:44.629180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a406-3579-40a2-a82c-e07cf681ace1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:44.629849 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a406-3579-40a2-a82c-e07cf681ace1 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.630157 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a406-3579-40a2-a82c-e07cf681ace1 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.630425 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7383a406-3579-40a2-a82c-e07cf681ace1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.642362 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4ef3b-9afe-4cf3-8180-7a0fbe179846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:44.643261 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4ef3b-9afe-4cf3-8180-7a0fbe179846 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.643865 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4ef3b-9afe-4cf3-8180-7a0fbe179846 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.644183 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4ef3b-9afe-4cf3-8180-7a0fbe179846 None admin] PATH_INFO: `/v3/users/c037cea25a404f0783e6ef90b07a1769` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.645416 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4ef3b-9afe-4cf3-8180-7a0fbe179846 None admin] RBAC: Authorizing `identity:get_user(user_id=c037cea25a404f0783e6ef90b07a1769)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:44.646882 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4ef3b-9afe-4cf3-8180-7a0fbe179846 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:44.648577 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 42/78] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:44 2022] GET /identity/v3/users/c037cea25a404f0783e6ef90b07a1769 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:44.649366 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4ef3b-9afe-4cf3-8180-7a0fbe179846 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:44.700741 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383a406-3579-40a2-a82c-e07cf681ace1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:44.702802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7383a406-3579-40a2-a82c-e07cf681ace1 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:44.751146 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4ef3b-9afe-4cf3-8180-7a0fbe179846 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:44.769269 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:44.774960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:44.791492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8bbb2c-3bc8-41c9-8572-879070f31cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:44.792402 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bbb2c-3bc8-41c9-8572-879070f31cad None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.792692 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bbb2c-3bc8-41c9-8572-879070f31cad None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.792973 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8bbb2c-3bc8-41c9-8572-879070f31cad None admin] PATH_INFO: `/v3/users/945bb5172fb64c3a9a54077b32240aed` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.794196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bbb2c-3bc8-41c9-8572-879070f31cad None admin] RBAC: Authorizing `identity:get_user(user_id=945bb5172fb64c3a9a54077b32240aed)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:44.795875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8bbb2c-3bc8-41c9-8572-879070f31cad None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:44.800159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 43/79] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:44 2022] GET /identity/v3/users/945bb5172fb64c3a9a54077b32240aed => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:44.800314 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15d3e2-b514-4670-bea1-f2cad492886d None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.800629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15d3e2-b514-4670-bea1-f2cad492886d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.801048 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a15d3e2-b514-4670-bea1-f2cad492886d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.813000 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 37/80] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:55:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:55:44.813874 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a406-3579-40a2-a82c-e07cf681ace1 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:44.823284 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-3a15d3e2-b514-4670-bea1-f2cad492886d None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:44.824559 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-3a15d3e2-b514-4670-bea1-f2cad492886d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:44.899186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 44/81] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:44.905846 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15d3e2-b514-4670-bea1-f2cad492886d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:44.931140 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7383a406-3579-40a2-a82c-e07cf681ace1 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:44.965862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63d44b-1c0e-4e76-9739-4bcedde182b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:44.966665 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63d44b-1c0e-4e76-9739-4bcedde182b5 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:44.966952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63d44b-1c0e-4e76-9739-4bcedde182b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:44.967869 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b63d44b-1c0e-4e76-9739-4bcedde182b5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:44.978233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b63d44b-1c0e-4e76-9739-4bcedde182b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-0b63d44b-1c0e-4e76-9739-4bcedde182b5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:44.985932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:44.986798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 38/82] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:55:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:55:44.992666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63d44b-1c0e-4e76-9739-4bcedde182b5 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:45.003062 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a15d3e2-b514-4670-bea1-f2cad492886d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:45.017406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:45.028727 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:45.043457 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66041312-20de-44ea-9b98-f63524a457a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:45.044196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041312-20de-44ea-9b98-f63524a457a4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:45.044441 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041312-20de-44ea-9b98-f63524a457a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:45.044725 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66041312-20de-44ea-9b98-f63524a457a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:45.093194 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b63d44b-1c0e-4e76-9739-4bcedde182b5 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:45.115905 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66041312-20de-44ea-9b98-f63524a457a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:45.117443 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66041312-20de-44ea-9b98-f63524a457a4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:45.132700 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec756d3e-8553-4937-af01-7b4ea2655218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:45.132700 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec756d3e-8553-4937-af01-7b4ea2655218 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:45.133032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec756d3e-8553-4937-af01-7b4ea2655218 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:45.133400 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec756d3e-8553-4937-af01-7b4ea2655218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:45.208413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec756d3e-8553-4937-af01-7b4ea2655218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:45.209918 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec756d3e-8553-4937-af01-7b4ea2655218 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:45.235613 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 45/83] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:55:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:55:45.240612 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:45.241079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66041312-20de-44ea-9b98-f63524a457a4 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:45.265124 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:45.318635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 39/84] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:55:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:55:45.319800 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec756d3e-8553-4937-af01-7b4ea2655218 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:45.357306 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66041312-20de-44ea-9b98-f63524a457a4 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:45.398389 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b2f12-8bb1-4258-ad7d-0ada7e7951f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:45.399763 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b2f12-8bb1-4258-ad7d-0ada7e7951f8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:45.400256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b2f12-8bb1-4258-ad7d-0ada7e7951f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:45.400718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52b2f12-8bb1-4258-ad7d-0ada7e7951f8 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:45.402857 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b2f12-8bb1-4258-ad7d-0ada7e7951f8 None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:45.405759 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52b2f12-8bb1-4258-ad7d-0ada7e7951f8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:45.413845 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 46/85] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:55:45 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:45.413845 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b2f12-8bb1-4258-ad7d-0ada7e7951f8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:45.445142 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec756d3e-8553-4937-af01-7b4ea2655218 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:45.479448 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:45.490319 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060dbc8-8e14-495e-b811-a94352b97a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:45.491594 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060dbc8-8e14-495e-b811-a94352b97a78 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:45.492060 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060dbc8-8e14-495e-b811-a94352b97a78 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:45.492558 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0060dbc8-8e14-495e-b811-a94352b97a78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:45.494478 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060dbc8-8e14-495e-b811-a94352b97a78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:45.496874 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0060dbc8-8e14-495e-b811-a94352b97a78 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:45.499671 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 40/86] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:55:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:45.499671 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060dbc8-8e14-495e-b811-a94352b97a78 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:45.515443 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:45.529332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52b2f12-8bb1-4258-ad7d-0ada7e7951f8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:45.565734 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130610ce-5f2f-40f2-a908-15dd0a038669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:45.566413 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130610ce-5f2f-40f2-a908-15dd0a038669 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:45.566709 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130610ce-5f2f-40f2-a908-15dd0a038669 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:45.566989 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130610ce-5f2f-40f2-a908-15dd0a038669 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:45.567755 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130610ce-5f2f-40f2-a908-15dd0a038669 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:45.568070 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130610ce-5f2f-40f2-a908-15dd0a038669 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:45.569496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130610ce-5f2f-40f2-a908-15dd0a038669 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:45.578657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 47/87] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:55:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:45.578657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130610ce-5f2f-40f2-a908-15dd0a038669 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:45.613441 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0060dbc8-8e14-495e-b811-a94352b97a78 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:45.652599 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d7bc1-1f82-4cc8-b6d1-91a3ff76b6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:45.653621 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7bc1-1f82-4cc8-b6d1-91a3ff76b6ac None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:45.654036 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7bc1-1f82-4cc8-b6d1-91a3ff76b6ac None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:45.654466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14d7bc1-1f82-4cc8-b6d1-91a3ff76b6ac None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:45.656431 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d7bc1-1f82-4cc8-b6d1-91a3ff76b6ac None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:45.658019 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14d7bc1-1f82-4cc8-b6d1-91a3ff76b6ac None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:45.659844 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 41/88] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:55:45 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:45.660782 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d7bc1-1f82-4cc8-b6d1-91a3ff76b6ac None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:45.700557 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130610ce-5f2f-40f2-a908-15dd0a038669 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:45.734883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:45.737933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d6fb8-2d90-484f-9813-4d72666910d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:45.739038 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d6fb8-2d90-484f-9813-4d72666910d9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:45.739369 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d6fb8-2d90-484f-9813-4d72666910d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:45.739917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d6fb8-2d90-484f-9813-4d72666910d9 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:45.741182 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d6fb8-2d90-484f-9813-4d72666910d9 None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:45.742634 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d6fb8-2d90-484f-9813-4d72666910d9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:45.744357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 48/89] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:55:45 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:45.745116 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d6fb8-2d90-484f-9813-4d72666910d9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:45.767133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:45.779230 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14d7bc1-1f82-4cc8-b6d1-91a3ff76b6ac None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:45.817561 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995a9b6-a994-40ab-8ffd-f7767451eb27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:45.818217 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995a9b6-a994-40ab-8ffd-f7767451eb27 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:45.818517 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995a9b6-a994-40ab-8ffd-f7767451eb27 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:45.818788 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0995a9b6-a994-40ab-8ffd-f7767451eb27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:45.819619 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995a9b6-a994-40ab-8ffd-f7767451eb27 None admin] RBAC: Adding query filter params (role.id=0e5f3c37f30e45da98262a20b891833d, scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b, user.id=c037cea25a404f0783e6ef90b07a1769) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:45.819934 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995a9b6-a994-40ab-8ffd-f7767451eb27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:45.821443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0995a9b6-a994-40ab-8ffd-f7767451eb27 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:45.828982 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 42/90] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:55:45 2022] GET /identity/v3/role_assignments?user.id=c037cea25a404f0783e6ef90b07a1769&scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b&role.id=0e5f3c37f30e45da98262a20b891833d => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:45.829809 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995a9b6-a994-40ab-8ffd-f7767451eb27 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:45.860603 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d6fb8-2d90-484f-9813-4d72666910d9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:45.911242 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bb604-8f09-4453-b659-4e63c9000771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:45.911926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bb604-8f09-4453-b659-4e63c9000771 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:45.912237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bb604-8f09-4453-b659-4e63c9000771 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:45.912518 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378bb604-8f09-4453-b659-4e63c9000771 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:45.913267 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bb604-8f09-4453-b659-4e63c9000771 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:45.914775 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378bb604-8f09-4453-b659-4e63c9000771 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:45.938656 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 49/91] 10.222.0.25 () {60 vars in 1132 bytes} [Wed May 25 07:55:45 2022] POST /identity/v3/users => generated 289 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:55:45.939597 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bb604-8f09-4453-b659-4e63c9000771 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:46.040877 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0995a9b6-a994-40ab-8ffd-f7767451eb27 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:46.071025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:46.112605 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:46.117639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378bb604-8f09-4453-b659-4e63c9000771 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:46.119334 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293ff02-51e6-48ab-87b0-ea8ffd1d09bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:46.123179 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293ff02-51e6-48ab-87b0-ea8ffd1d09bd None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:46.124659 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293ff02-51e6-48ab-87b0-ea8ffd1d09bd None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:46.125383 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2293ff02-51e6-48ab-87b0-ea8ffd1d09bd None admin] PATH_INFO: `/v3/users/c037cea25a404f0783e6ef90b07a1769` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:46.127799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293ff02-51e6-48ab-87b0-ea8ffd1d09bd None admin] RBAC: Authorizing `identity:get_user(user_id=c037cea25a404f0783e6ef90b07a1769)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:46.130675 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2293ff02-51e6-48ab-87b0-ea8ffd1d09bd None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:46.134919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 43/92] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:45 2022] GET /identity/v3/users/c037cea25a404f0783e6ef90b07a1769 => generated 275 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:46.136622 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293ff02-51e6-48ab-87b0-ea8ffd1d09bd None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:46.184747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb785e1-a69a-41fd-8ca5-48fb5e356887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:46.185427 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb785e1-a69a-41fd-8ca5-48fb5e356887 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:46.185726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb785e1-a69a-41fd-8ca5-48fb5e356887 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:46.186557 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb785e1-a69a-41fd-8ca5-48fb5e356887 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:46.188285 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb785e1-a69a-41fd-8ca5-48fb5e356887 None admin] RBAC: Adding query filter params (role.id=fb458495153d4239becfaff1b68b012e, scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b, user.id=c037cea25a404f0783e6ef90b07a1769) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:46.188614 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb785e1-a69a-41fd-8ca5-48fb5e356887 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:46.190133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb785e1-a69a-41fd-8ca5-48fb5e356887 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:46.197026 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 50/93] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:55:45 2022] GET /identity/v3/role_assignments?user.id=c037cea25a404f0783e6ef90b07a1769&scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b&role.id=fb458495153d4239becfaff1b68b012e => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:46.203082 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb785e1-a69a-41fd-8ca5-48fb5e356887 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:46.356323 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2293ff02-51e6-48ab-87b0-ea8ffd1d09bd None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:46.424734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2c8c5-557d-41d0-87af-e882d7b1063a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:46.426204 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2c8c5-557d-41d0-87af-e882d7b1063a None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:46.426671 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2c8c5-557d-41d0-87af-e882d7b1063a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:46.427147 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf2c8c5-557d-41d0-87af-e882d7b1063a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:46.428665 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2c8c5-557d-41d0-87af-e882d7b1063a None admin] RBAC: Adding query filter params (role.id=5c1382efdc2e4eebaf5f15a4cdae58e0, scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b, user.id=945bb5172fb64c3a9a54077b32240aed) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:46.429194 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2c8c5-557d-41d0-87af-e882d7b1063a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:46.431299 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf2c8c5-557d-41d0-87af-e882d7b1063a None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:46.435666 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb785e1-a69a-41fd-8ca5-48fb5e356887 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:46.447128 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 44/94] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:55:46 2022] GET /identity/v3/role_assignments?user.id=945bb5172fb64c3a9a54077b32240aed&scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b&role.id=5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 259 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:46.482156 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80973098-051f-4365-8d5d-189baa9db1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:46.483388 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973098-051f-4365-8d5d-189baa9db1c1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:46.483676 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973098-051f-4365-8d5d-189baa9db1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:46.483953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80973098-051f-4365-8d5d-189baa9db1c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:46.497028 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:46.585348 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80973098-051f-4365-8d5d-189baa9db1c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:46.586959 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80973098-051f-4365-8d5d-189baa9db1c1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:46.773627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 51/95] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:55:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:55:46.784525 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2c8c5-557d-41d0-87af-e882d7b1063a None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:46.937741 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:47.040054 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf2c8c5-557d-41d0-87af-e882d7b1063a None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:47.126462 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efcf8e0-d3ac-40d3-814f-04b3511f1081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:47.127987 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf8e0-d3ac-40d3-814f-04b3511f1081 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:47.128517 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf8e0-d3ac-40d3-814f-04b3511f1081 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:47.129023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efcf8e0-d3ac-40d3-814f-04b3511f1081 None admin] PATH_INFO: `/v3/projects/d846beea108a41809d1cf07f5239e017` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:47.131275 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcf8e0-d3ac-40d3-814f-04b3511f1081 None admin] RBAC: Authorizing `identity:get_project(project_id=d846beea108a41809d1cf07f5239e017)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:47.134000 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efcf8e0-d3ac-40d3-814f-04b3511f1081 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:47.137280 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 45/96] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:55:46 2022] GET /identity/v3/projects/d846beea108a41809d1cf07f5239e017 => generated 312 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:47.147608 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80973098-051f-4365-8d5d-189baa9db1c1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:47.243642 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:47.348625 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80973098-051f-4365-8d5d-189baa9db1c1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:47.394371 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2b0d7d-1a5c-41c7-9af8-25e9509b45ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:47.395042 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b0d7d-1a5c-41c7-9af8-25e9509b45ca None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:47.395327 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b0d7d-1a5c-41c7-9af8-25e9509b45ca None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:47.395602 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2b0d7d-1a5c-41c7-9af8-25e9509b45ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:47.396483 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b0d7d-1a5c-41c7-9af8-25e9509b45ca None admin] RBAC: Adding query filter params (role.id=0e5f3c37f30e45da98262a20b891833d, scope.project.id=d846beea108a41809d1cf07f5239e017, user.id=c037cea25a404f0783e6ef90b07a1769) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:47.396800 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b0d7d-1a5c-41c7-9af8-25e9509b45ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:47.398359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2b0d7d-1a5c-41c7-9af8-25e9509b45ca None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:47.410304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 52/97] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:55:47 2022] GET /identity/v3/role_assignments?user.id=c037cea25a404f0783e6ef90b07a1769&scope.project.id=d846beea108a41809d1cf07f5239e017&role.id=0e5f3c37f30e45da98262a20b891833d => generated 259 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:49.526522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c1f1-0083-4f9d-8f89-b60490da893c None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:49.527106 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c1f1-0083-4f9d-8f89-b60490da893c None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:49.527406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c1f1-0083-4f9d-8f89-b60490da893c None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:49.529896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 46/98] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:49.536351 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af924177-9776-4792-8c0f-46753bc97522 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:49.536884 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af924177-9776-4792-8c0f-46753bc97522 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:49.536884 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af924177-9776-4792-8c0f-46753bc97522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:49.570159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-af924177-9776-4792-8c0f-46753bc97522 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:49.571607 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-af924177-9776-4792-8c0f-46753bc97522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:49.670877 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 53/99] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:49.717776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808c1f1-0083-4f9d-8f89-b60490da893c None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:49.894181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808c1f1-0083-4f9d-8f89-b60490da893c None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:49.929307 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:49.944105 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65b9de-4e86-49fe-a935-5e1b1bc4519a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:49.945012 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65b9de-4e86-49fe-a935-5e1b1bc4519a None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:49.945309 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65b9de-4e86-49fe-a935-5e1b1bc4519a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:49.945599 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe65b9de-4e86-49fe-a935-5e1b1bc4519a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:49.970776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe65b9de-4e86-49fe-a935-5e1b1bc4519a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-fe65b9de-4e86-49fe-a935-5e1b1bc4519a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:49.978802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:49.979868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:49.981148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:49.981148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:49.981148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:49.981148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:49.981148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:49.981148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:49.981148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:49.981148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:49.981148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:49.981148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:49.981148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:55:49.981148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:55:49.981148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 47/100] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:55:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:55:49.988805 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af924177-9776-4792-8c0f-46753bc97522 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:50.055516 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:50.163469 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af924177-9776-4792-8c0f-46753bc97522 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:50.213105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35db0d34-d40e-43f8-8245-67af4300e46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:50.214238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db0d34-d40e-43f8-8245-67af4300e46e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:50.214753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db0d34-d40e-43f8-8245-67af4300e46e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:50.215239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35db0d34-d40e-43f8-8245-67af4300e46e None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:50.216337 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db0d34-d40e-43f8-8245-67af4300e46e None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:50.216966 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db0d34-d40e-43f8-8245-67af4300e46e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:50.219218 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35db0d34-d40e-43f8-8245-67af4300e46e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:50.233400 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 54/101] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:55:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:50.241125 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65b9de-4e86-49fe-a935-5e1b1bc4519a None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:50.291447 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b5d39-7eb7-428b-ac5d-4d40be413c8a None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:50.292084 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b5d39-7eb7-428b-ac5d-4d40be413c8a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:50.292637 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913b5d39-7eb7-428b-ac5d-4d40be413c8a None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:50.294612 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 55/102] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:50.315253 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aecfe5-64bf-4b54-bc0f-d75d2b864f5c None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:50.315890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aecfe5-64bf-4b54-bc0f-d75d2b864f5c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:50.316421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aecfe5-64bf-4b54-bc0f-d75d2b864f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:50.346329 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-46aecfe5-64bf-4b54-bc0f-d75d2b864f5c None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:50.347974 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-46aecfe5-64bf-4b54-bc0f-d75d2b864f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:50.530054 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 56/103] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:50.543015 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe65b9de-4e86-49fe-a935-5e1b1bc4519a None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:50.618357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7f38e-ab32-4744-b640-0224bc052084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:50.619276 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7f38e-ab32-4744-b640-0224bc052084 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:50.619561 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7f38e-ab32-4744-b640-0224bc052084 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:50.619855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea7f38e-ab32-4744-b640-0224bc052084 None admin] PATH_INFO: `/v3/users/c037cea25a404f0783e6ef90b07a1769` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:50.621294 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aecfe5-64bf-4b54-bc0f-d75d2b864f5c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:50.624313 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7f38e-ab32-4744-b640-0224bc052084 None admin] RBAC: Authorizing `identity:get_user(user_id=c037cea25a404f0783e6ef90b07a1769)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:50.627764 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea7f38e-ab32-4744-b640-0224bc052084 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:50.627907 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 48/104] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:50 2022] GET /identity/v3/users/c037cea25a404f0783e6ef90b07a1769 => generated 275 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:50.643248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7f38e-ab32-4744-b640-0224bc052084 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:50.677480 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:50.760877 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:50.842997 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea7f38e-ab32-4744-b640-0224bc052084 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:50.856402 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aecfe5-64bf-4b54-bc0f-d75d2b864f5c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:50.899709 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e48565-c1cd-4821-b1e3-860cc9add229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:50.900947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e48565-c1cd-4821-b1e3-860cc9add229 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:50.901480 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e48565-c1cd-4821-b1e3-860cc9add229 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:50.902214 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e48565-c1cd-4821-b1e3-860cc9add229 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:50.905196 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e48565-c1cd-4821-b1e3-860cc9add229 None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:50.908556 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e48565-c1cd-4821-b1e3-860cc9add229 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:50.908761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9622a4-36e8-45a0-b8d5-5d224bdfe3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:50.909426 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9622a4-36e8-45a0-b8d5-5d224bdfe3f0 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:50.909775 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9622a4-36e8-45a0-b8d5-5d224bdfe3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:50.910031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9622a4-36e8-45a0-b8d5-5d224bdfe3f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:50.913947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 49/105] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:55:50 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:50.921841 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4d7f9-9b91-4321-8db5-cbfb0caeb21f None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:50.922793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4d7f9-9b91-4321-8db5-cbfb0caeb21f None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:50.923357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9622a4-36e8-45a0-b8d5-5d224bdfe3f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:50.923973 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4d7f9-9b91-4321-8db5-cbfb0caeb21f None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:50.931158 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 50/106] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:50 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:50.934284 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01422a-1435-496e-8a59-865598582238 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:50.935113 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01422a-1435-496e-8a59-865598582238 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-fe9622a4-36e8-45a0-b8d5-5d224bdfe3f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:50.936569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:50.938797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 57/107] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:55:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:55:50.940696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9622a4-36e8-45a0-b8d5-5d224bdfe3f0 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:50.943159 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01422a-1435-496e-8a59-865598582238 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:50.946560 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 51/108] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:50 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:50.949499 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657d794-42a1-42d3-8a1d-9070be6201b4 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:50.950419 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657d794-42a1-42d3-8a1d-9070be6201b4 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:50.951257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2657d794-42a1-42d3-8a1d-9070be6201b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:50.988560 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-2657d794-42a1-42d3-8a1d-9070be6201b4 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:50.990746 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-2657d794-42a1-42d3-8a1d-9070be6201b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:51.046425 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:51.067321 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9622a4-36e8-45a0-b8d5-5d224bdfe3f0 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:51.119592 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cd1c09-1c15-46ab-92c0-11991dc259be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:51.121110 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd1c09-1c15-46ab-92c0-11991dc259be None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:51.121590 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd1c09-1c15-46ab-92c0-11991dc259be None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:51.122054 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cd1c09-1c15-46ab-92c0-11991dc259be None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b/users/c037cea25a404f0783e6ef90b07a1769/roles/0e5f3c37f30e45da98262a20b891833d` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:51.126125 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd1c09-1c15-46ab-92c0-11991dc259be None admin] RBAC: Authorizing `identity:create_grant(project_id=b49bdd94998e4f67af5ef2d3eb963c3b, user_id=c037cea25a404f0783e6ef90b07a1769, role_id=0e5f3c37f30e45da98262a20b891833d)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:51.128796 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cd1c09-1c15-46ab-92c0-11991dc259be None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:51.140378 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 52/109] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:51.140378 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657d794-42a1-42d3-8a1d-9070be6201b4 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:51.167969 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 58/110] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:55:50 2022] PUT /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b/users/c037cea25a404f0783e6ef90b07a1769/roles/0e5f3c37f30e45da98262a20b891833d => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:55:51.177179 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aefc46-62f7-474c-b94d-e6f018ebba97 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:51.177681 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aefc46-62f7-474c-b94d-e6f018ebba97 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:51.178200 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00aefc46-62f7-474c-b94d-e6f018ebba97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:51.223410 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-00aefc46-62f7-474c-b94d-e6f018ebba97 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:51.225393 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-00aefc46-62f7-474c-b94d-e6f018ebba97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:51.248843 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:51.340407 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 59/111] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:51.340407 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1d51d-cc81-4b36-a65f-cc3d997febc6 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:51.340407 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1d51d-cc81-4b36-a65f-cc3d997febc6 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:51.340407 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab1d51d-cc81-4b36-a65f-cc3d997febc6 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:51.356514 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2657d794-42a1-42d3-8a1d-9070be6201b4 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:51.357373 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 60/112] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:51 2022] GET /identity => generated 270 bytes in 20 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:51.359506 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1d51d-cc81-4b36-a65f-cc3d997febc6 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:51.413083 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1adb97c-eef7-445e-9d8e-f21e51c6b379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:51.414759 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adb97c-eef7-445e-9d8e-f21e51c6b379 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:51.415558 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adb97c-eef7-445e-9d8e-f21e51c6b379 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:51.416312 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1adb97c-eef7-445e-9d8e-f21e51c6b379 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:51.417387 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adb97c-eef7-445e-9d8e-f21e51c6b379 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:51.417924 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adb97c-eef7-445e-9d8e-f21e51c6b379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:51.420975 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1adb97c-eef7-445e-9d8e-f21e51c6b379 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:51.434420 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 53/113] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:55:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:51.436400 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb5bfb-9ee0-4d57-8071-bfc3e008b848 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:51.436715 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb5bfb-9ee0-4d57-8071-bfc3e008b848 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:51.436999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05eb5bfb-9ee0-4d57-8071-bfc3e008b848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:51.459738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-05eb5bfb-9ee0-4d57-8071-bfc3e008b848 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:51.461205 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-05eb5bfb-9ee0-4d57-8071-bfc3e008b848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:51.501712 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:51.534846 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab1d51d-cc81-4b36-a65f-cc3d997febc6 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:51.576620 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86112ff-4875-498f-ae84-df77525068fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:51.578161 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86112ff-4875-498f-ae84-df77525068fb None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:51.578795 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86112ff-4875-498f-ae84-df77525068fb None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:51.579486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86112ff-4875-498f-ae84-df77525068fb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:51.588742 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 54/114] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:51.590211 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb5bfb-9ee0-4d57-8071-bfc3e008b848 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:51.609691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86112ff-4875-498f-ae84-df77525068fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-c86112ff-4875-498f-ae84-df77525068fb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:51.628824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:51.631274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:51.633728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:51.633728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:51.633728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:51.633728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:51.633728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:51.633728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:51.633728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:51.633728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:51.633728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:51.633728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:51.633728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:55:51.633728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:55:51.633728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 61/115] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:55:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:55:51.635848 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e965f-bbdc-4b9e-b3c9-90268291c684 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:51.635848 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e965f-bbdc-4b9e-b3c9-90268291c684 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:51.636340 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262e965f-bbdc-4b9e-b3c9-90268291c684 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:51.644473 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 62/116] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:51.644473 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e965f-bbdc-4b9e-b3c9-90268291c684 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:51.667198 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:51.738600 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05eb5bfb-9ee0-4d57-8071-bfc3e008b848 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:51.790099 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8899cc6-3e4f-4564-9627-55a2906a1c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:51.790924 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8899cc6-3e4f-4564-9627-55a2906a1c08 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:51.791211 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8899cc6-3e4f-4564-9627-55a2906a1c08 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:51.791557 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8899cc6-3e4f-4564-9627-55a2906a1c08 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:51.792860 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8899cc6-3e4f-4564-9627-55a2906a1c08 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:51.794123 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262e965f-bbdc-4b9e-b3c9-90268291c684 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:51.794283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8899cc6-3e4f-4564-9627-55a2906a1c08 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:51.796410 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 55/117] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:55:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:51.801307 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8899cc6-3e4f-4564-9627-55a2906a1c08 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:51.840035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5024d-d2b3-4d57-9f44-ec3b4aa5ce23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:51.841221 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5024d-d2b3-4d57-9f44-ec3b4aa5ce23 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:51.841655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5024d-d2b3-4d57-9f44-ec3b4aa5ce23 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:51.842655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b5024d-d2b3-4d57-9f44-ec3b4aa5ce23 None admin] PATH_INFO: `/v3/users/945bb5172fb64c3a9a54077b32240aed` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:51.844595 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5024d-d2b3-4d57-9f44-ec3b4aa5ce23 None admin] RBAC: Authorizing `identity:get_user(user_id=945bb5172fb64c3a9a54077b32240aed)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:51.846299 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b5024d-d2b3-4d57-9f44-ec3b4aa5ce23 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:51.848525 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 63/118] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:51 2022] GET /identity/v3/users/945bb5172fb64c3a9a54077b32240aed => generated 247 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:51.849355 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5024d-d2b3-4d57-9f44-ec3b4aa5ce23 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:51.852998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:51.967644 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8899cc6-3e4f-4564-9627-55a2906a1c08 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:51.990662 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:52.026852 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae208f04-86ae-4e71-822e-7d852c084ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:52.028058 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae208f04-86ae-4e71-822e-7d852c084ebc None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:52.028503 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae208f04-86ae-4e71-822e-7d852c084ebc None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:52.028907 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae208f04-86ae-4e71-822e-7d852c084ebc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:52.031054 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b5024d-d2b3-4d57-9f44-ec3b4aa5ce23 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:52.041754 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae208f04-86ae-4e71-822e-7d852c084ebc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-ae208f04-86ae-4e71-822e-7d852c084ebc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:52.051115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:52.052020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:52.053289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:52.053289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:52.053289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:52.053289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:52.053289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:52.053289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:52.053289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:52.053289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:52.053289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:52.053289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:52.053289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:55:52.053289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:55:52.056051 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 56/119] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:55:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:55:52.057898 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5c953-8230-4043-9c7b-b5ddf4f34a15 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:52.058575 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5c953-8230-4043-9c7b-b5ddf4f34a15 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:52.059217 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c5c953-8230-4043-9c7b-b5ddf4f34a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:52.085764 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-18c5c953-8230-4043-9c7b-b5ddf4f34a15 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:52.087441 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-18c5c953-8230-4043-9c7b-b5ddf4f34a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:52.100766 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526868d-c625-4e4a-9d6d-24b58530a8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:52.101937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526868d-c625-4e4a-9d6d-24b58530a8c4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:52.102891 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526868d-c625-4e4a-9d6d-24b58530a8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:52.103417 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526868d-c625-4e4a-9d6d-24b58530a8c4 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:52.104939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526868d-c625-4e4a-9d6d-24b58530a8c4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:52.105493 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526868d-c625-4e4a-9d6d-24b58530a8c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:52.108244 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526868d-c625-4e4a-9d6d-24b58530a8c4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:52.124979 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 64/120] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:55:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:52.126590 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526868d-c625-4e4a-9d6d-24b58530a8c4 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:52.202563 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 57/121] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:52.204534 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5c953-8230-4043-9c7b-b5ddf4f34a15 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:52.220616 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:52.282942 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526868d-c625-4e4a-9d6d-24b58530a8c4 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:52.323228 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6a929-822d-405f-a06e-9d9d9fa0379b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:52.324072 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6a929-822d-405f-a06e-9d9d9fa0379b None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:52.324589 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6a929-822d-405f-a06e-9d9d9fa0379b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:52.325040 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa6a929-822d-405f-a06e-9d9d9fa0379b None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:52.325898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6a929-822d-405f-a06e-9d9d9fa0379b None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:52.328061 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa6a929-822d-405f-a06e-9d9d9fa0379b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:52.358773 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 65/122] 10.222.0.25 () {60 vars in 1141 bytes} [Wed May 25 07:55:52 2022] POST /identity/v3/projects => generated 302 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:55:52.359893 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6a929-822d-405f-a06e-9d9d9fa0379b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:52.422573 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c5c953-8230-4043-9c7b-b5ddf4f34a15 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:52.428311 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:52.501875 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70a902-8575-4ee7-9e25-a6d4d9f64d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:52.503811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70a902-8575-4ee7-9e25-a6d4d9f64d69 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:52.504542 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70a902-8575-4ee7-9e25-a6d4d9f64d69 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:52.505172 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70a902-8575-4ee7-9e25-a6d4d9f64d69 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:52.508013 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70a902-8575-4ee7-9e25-a6d4d9f64d69 None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:52.511353 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70a902-8575-4ee7-9e25-a6d4d9f64d69 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:52.515432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 58/123] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:55:52 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:52.521789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70a902-8575-4ee7-9e25-a6d4d9f64d69 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:52.577342 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa6a929-822d-405f-a06e-9d9d9fa0379b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:52.612881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:52.652386 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3bd68-8252-427d-9f4c-aa3c5361d0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:52.653292 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3bd68-8252-427d-9f4c-aa3c5361d0f4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:52.653423 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3bd68-8252-427d-9f4c-aa3c5361d0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:52.653636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf3bd68-8252-427d-9f4c-aa3c5361d0f4 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:52.654747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3bd68-8252-427d-9f4c-aa3c5361d0f4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:52.655069 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3bd68-8252-427d-9f4c-aa3c5361d0f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:52.657503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf3bd68-8252-427d-9f4c-aa3c5361d0f4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:52.673201 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 66/124] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:55:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:52.675257 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3bd68-8252-427d-9f4c-aa3c5361d0f4 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:52.699110 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70a902-8575-4ee7-9e25-a6d4d9f64d69 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:52.740909 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595e990-05eb-41f0-9f26-be44b6067c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:52.741866 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595e990-05eb-41f0-9f26-be44b6067c29 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:52.742154 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595e990-05eb-41f0-9f26-be44b6067c29 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:52.742438 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5595e990-05eb-41f0-9f26-be44b6067c29 None admin] PATH_INFO: `/v3/users/c037cea25a404f0783e6ef90b07a1769` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:52.744028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595e990-05eb-41f0-9f26-be44b6067c29 None admin] RBAC: Authorizing `identity:get_user(user_id=c037cea25a404f0783e6ef90b07a1769)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:52.746565 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5595e990-05eb-41f0-9f26-be44b6067c29 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:52.749011 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 59/125] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:52 2022] GET /identity/v3/users/c037cea25a404f0783e6ef90b07a1769 => generated 275 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:52.750047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595e990-05eb-41f0-9f26-be44b6067c29 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:52.820878 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:52.852583 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf3bd68-8252-427d-9f4c-aa3c5361d0f4 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:52.898020 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcdcc7-7d35-46db-86ce-01e6ec0486b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:52.898930 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcdcc7-7d35-46db-86ce-01e6ec0486b2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:52.899170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcdcc7-7d35-46db-86ce-01e6ec0486b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:52.899415 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fcdcc7-7d35-46db-86ce-01e6ec0486b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:52.914113 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fcdcc7-7d35-46db-86ce-01e6ec0486b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-58fcdcc7-7d35-46db-86ce-01e6ec0486b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:52.923304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:52.925010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 67/126] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:55:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:55:52.926445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcdcc7-7d35-46db-86ce-01e6ec0486b2 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:52.955544 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5595e990-05eb-41f0-9f26-be44b6067c29 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:53.002967 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3595bd-9d3f-4c5b-bb62-2b62cc6d880e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:53.003888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3595bd-9d3f-4c5b-bb62-2b62cc6d880e None admin] REQUEST_METHOD: `PUT` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:53.004224 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3595bd-9d3f-4c5b-bb62-2b62cc6d880e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:53.004513 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3595bd-9d3f-4c5b-bb62-2b62cc6d880e None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b/users/945bb5172fb64c3a9a54077b32240aed/roles/5c1382efdc2e4eebaf5f15a4cdae58e0` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:53.006620 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3595bd-9d3f-4c5b-bb62-2b62cc6d880e None admin] RBAC: Authorizing `identity:create_grant(project_id=b49bdd94998e4f67af5ef2d3eb963c3b, user_id=945bb5172fb64c3a9a54077b32240aed, role_id=5c1382efdc2e4eebaf5f15a4cdae58e0)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:53.008145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3595bd-9d3f-4c5b-bb62-2b62cc6d880e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:53.012799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:53.036169 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 60/127] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:55:52 2022] PUT /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b/users/945bb5172fb64c3a9a54077b32240aed/roles/5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:55:53.036807 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3595bd-9d3f-4c5b-bb62-2b62cc6d880e None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:53.176645 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fcdcc7-7d35-46db-86ce-01e6ec0486b2 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:53.260099 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da87325-8bf0-4514-bd70-43630390271c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:53.262341 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da87325-8bf0-4514-bd70-43630390271c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:53.263201 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da87325-8bf0-4514-bd70-43630390271c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:53.264933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da87325-8bf0-4514-bd70-43630390271c None admin] PATH_INFO: `/v3/users/2db4ceecad9e4f9b9314d562ea48bbf5` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:53.298495 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da87325-8bf0-4514-bd70-43630390271c None admin] RBAC: Authorizing `identity:get_user(user_id=2db4ceecad9e4f9b9314d562ea48bbf5)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:53.304733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da87325-8bf0-4514-bd70-43630390271c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:53.309838 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:53.312505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 68/128] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:52 2022] GET /identity/v3/users/2db4ceecad9e4f9b9314d562ea48bbf5 => generated 289 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:53.314233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3595bd-9d3f-4c5b-bb62-2b62cc6d880e None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:53.314717 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da87325-8bf0-4514-bd70-43630390271c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:53.363782 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3943580-ac3c-49be-bc2e-fef18b1b23ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:53.365648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3943580-ac3c-49be-bc2e-fef18b1b23ce None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:53.365944 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3943580-ac3c-49be-bc2e-fef18b1b23ce None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:53.366227 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3943580-ac3c-49be-bc2e-fef18b1b23ce None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:53.367563 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3943580-ac3c-49be-bc2e-fef18b1b23ce None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:53.369217 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3943580-ac3c-49be-bc2e-fef18b1b23ce None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:53.370905 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 61/129] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:55:53 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:53.371709 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3943580-ac3c-49be-bc2e-fef18b1b23ce None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:53.544049 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:53.551209 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da87325-8bf0-4514-bd70-43630390271c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:53.566013 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3943580-ac3c-49be-bc2e-fef18b1b23ce None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:53.591528 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda5f2f-79d7-4846-8e79-1dfc1a0ec5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:53.593006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5f2f-79d7-4846-8e79-1dfc1a0ec5c3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:53.593317 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5f2f-79d7-4846-8e79-1dfc1a0ec5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:53.593665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbda5f2f-79d7-4846-8e79-1dfc1a0ec5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:53.594512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda5f2f-79d7-4846-8e79-1dfc1a0ec5c3 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:53.594890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda5f2f-79d7-4846-8e79-1dfc1a0ec5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:53.596450 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbda5f2f-79d7-4846-8e79-1dfc1a0ec5c3 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:53.607160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 69/130] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:55:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:53.612291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda5f2f-79d7-4846-8e79-1dfc1a0ec5c3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:53.652457 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92c8bb-3ae2-447f-a1ef-d0ee4bea99a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:53.654044 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c8bb-3ae2-447f-a1ef-d0ee4bea99a6 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:53.654852 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c8bb-3ae2-447f-a1ef-d0ee4bea99a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:53.655568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f92c8bb-3ae2-447f-a1ef-d0ee4bea99a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:53.727589 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:53.805636 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92c8bb-3ae2-447f-a1ef-d0ee4bea99a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:53.808888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f92c8bb-3ae2-447f-a1ef-d0ee4bea99a6 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:53.843016 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbda5f2f-79d7-4846-8e79-1dfc1a0ec5c3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:53.939816 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e0e1-6f68-453f-92da-4eaa0715703d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:53.941119 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e0e1-6f68-453f-92da-4eaa0715703d None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:53.941618 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e0e1-6f68-453f-92da-4eaa0715703d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:53.942124 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421e0e1-6f68-453f-92da-4eaa0715703d None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b/users/c037cea25a404f0783e6ef90b07a1769/roles/fb458495153d4239becfaff1b68b012e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:53.946125 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421e0e1-6f68-453f-92da-4eaa0715703d None admin] RBAC: Authorizing `identity:create_grant(project_id=b49bdd94998e4f67af5ef2d3eb963c3b, user_id=c037cea25a404f0783e6ef90b07a1769, role_id=fb458495153d4239becfaff1b68b012e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:53.947806 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421e0e1-6f68-453f-92da-4eaa0715703d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:54.005107 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 70/131] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:55:53 2022] PUT /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b/users/c037cea25a404f0783e6ef90b07a1769/roles/fb458495153d4239becfaff1b68b012e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:55:54.006253 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e0e1-6f68-453f-92da-4eaa0715703d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:54.040169 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 62/132] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:55:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 669 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:55:54.054025 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92c8bb-3ae2-447f-a1ef-d0ee4bea99a6 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:54.071095 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:54.258440 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:54.314525 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421e0e1-6f68-453f-92da-4eaa0715703d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:54.347816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f92c8bb-3ae2-447f-a1ef-d0ee4bea99a6 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:54.385893 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324fd0b-1503-415c-92c9-431b0fb1774a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:54.387560 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324fd0b-1503-415c-92c9-431b0fb1774a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:54.388091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324fd0b-1503-415c-92c9-431b0fb1774a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:54.388683 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324fd0b-1503-415c-92c9-431b0fb1774a None admin] PATH_INFO: `/v3/users/c037cea25a404f0783e6ef90b07a1769` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:54.393620 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324fd0b-1503-415c-92c9-431b0fb1774a None admin] RBAC: Authorizing `identity:get_user(user_id=c037cea25a404f0783e6ef90b07a1769)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:54.395843 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324fd0b-1503-415c-92c9-431b0fb1774a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:54.398150 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 71/133] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:54 2022] GET /identity/v3/users/c037cea25a404f0783e6ef90b07a1769 => generated 275 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:54.405447 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324fd0b-1503-415c-92c9-431b0fb1774a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:54.447394 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bd8b1-d3ea-4c47-8958-688be1926b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:54.448930 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bd8b1-d3ea-4c47-8958-688be1926b7f None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:54.449404 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bd8b1-d3ea-4c47-8958-688be1926b7f None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:54.449908 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927bd8b1-d3ea-4c47-8958-688be1926b7f None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:54.457164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bd8b1-d3ea-4c47-8958-688be1926b7f None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:54.458964 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927bd8b1-d3ea-4c47-8958-688be1926b7f None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:54.460970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 63/134] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:55:54 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:54.470852 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bd8b1-d3ea-4c47-8958-688be1926b7f None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:54.589188 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:54.621886 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324fd0b-1503-415c-92c9-431b0fb1774a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:54.688404 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d461e13-27c1-4580-a78d-2426fef0f55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:54.689292 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461e13-27c1-4580-a78d-2426fef0f55f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:54.689576 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461e13-27c1-4580-a78d-2426fef0f55f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:54.689855 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d461e13-27c1-4580-a78d-2426fef0f55f None admin] PATH_INFO: `/v3/projects/d846beea108a41809d1cf07f5239e017` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:54.691187 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d461e13-27c1-4580-a78d-2426fef0f55f None admin] RBAC: Authorizing `identity:get_project(project_id=d846beea108a41809d1cf07f5239e017)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:54.692704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d461e13-27c1-4580-a78d-2426fef0f55f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:54.694472 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 72/135] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:55:54 2022] GET /identity/v3/projects/d846beea108a41809d1cf07f5239e017 => generated 312 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:54.704904 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d461e13-27c1-4580-a78d-2426fef0f55f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:54.796985 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927bd8b1-d3ea-4c47-8958-688be1926b7f None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:54.863922 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf4dc0-244c-41e3-b9ec-958338b73c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:54.865151 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf4dc0-244c-41e3-b9ec-958338b73c64 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:54.865609 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf4dc0-244c-41e3-b9ec-958338b73c64 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:54.866131 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf4dc0-244c-41e3-b9ec-958338b73c64 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:54.868844 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf4dc0-244c-41e3-b9ec-958338b73c64 None admin] RBAC: Adding query filter params (role.id=040d082ba25f428a898a87057e2f7341, scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b, user.id=2db4ceecad9e4f9b9314d562ea48bbf5) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:54.869361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf4dc0-244c-41e3-b9ec-958338b73c64 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:54.873025 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf4dc0-244c-41e3-b9ec-958338b73c64 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:54.880537 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:54.886670 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 64/136] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:55:54 2022] GET /identity/v3/role_assignments?user.id=2db4ceecad9e4f9b9314d562ea48bbf5&scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b&role.id=040d082ba25f428a898a87057e2f7341 => generated 259 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:54.897242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ccfd1-72c9-4d72-b408-06e1d31d2997 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:54.897693 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ccfd1-72c9-4d72-b408-06e1d31d2997 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:54.898155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594ccfd1-72c9-4d72-b408-06e1d31d2997 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:54.900826 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 65/137] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:54 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:54.926539 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c02fb-1f7f-47bd-ba48-186876aeb9e2 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:54.926988 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c02fb-1f7f-47bd-ba48-186876aeb9e2 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:54.927429 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4c02fb-1f7f-47bd-ba48-186876aeb9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:54.975883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-9b4c02fb-1f7f-47bd-ba48-186876aeb9e2 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:54.978522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d461e13-27c1-4580-a78d-2426fef0f55f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:54.985134 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-9b4c02fb-1f7f-47bd-ba48-186876aeb9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:55.117228 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc850d3d-8d60-4ddd-9511-5b688abe5b5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:55.118723 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc850d3d-8d60-4ddd-9511-5b688abe5b5c None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:55.119327 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc850d3d-8d60-4ddd-9511-5b688abe5b5c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:55.119865 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc850d3d-8d60-4ddd-9511-5b688abe5b5c None admin] PATH_INFO: `/v3/projects/d846beea108a41809d1cf07f5239e017/users/c037cea25a404f0783e6ef90b07a1769/roles/0e5f3c37f30e45da98262a20b891833d` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:55.128561 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc850d3d-8d60-4ddd-9511-5b688abe5b5c None admin] RBAC: Authorizing `identity:create_grant(project_id=d846beea108a41809d1cf07f5239e017, user_id=c037cea25a404f0783e6ef90b07a1769, role_id=0e5f3c37f30e45da98262a20b891833d)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:55.130524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc850d3d-8d60-4ddd-9511-5b688abe5b5c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:55.162857 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 66/138] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:55.164766 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 73/139] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:55:54 2022] PUT /identity/v3/projects/d846beea108a41809d1cf07f5239e017/users/c037cea25a404f0783e6ef90b07a1769/roles/0e5f3c37f30e45da98262a20b891833d => generated 0 bytes in 460 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:55:55.213372 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c02fb-1f7f-47bd-ba48-186876aeb9e2 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:55.376623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4c02fb-1f7f-47bd-ba48-186876aeb9e2 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:55.419664 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:55.426958 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0095e4-afe7-4ffb-90cc-063b37ce56fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:55.427782 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0095e4-afe7-4ffb-90cc-063b37ce56fc None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:55.428067 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0095e4-afe7-4ffb-90cc-063b37ce56fc None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:55.428430 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0095e4-afe7-4ffb-90cc-063b37ce56fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:55.445023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0095e4-afe7-4ffb-90cc-063b37ce56fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-8f0095e4-afe7-4ffb-90cc-063b37ce56fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:55.453335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:55.454321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:55.456014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:55.456014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:55.456014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:55.456014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:55.456014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:55.456014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:55.456014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:55.456014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:55.456014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:55.456014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:55.456014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:55:55.456014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:55:55.456014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 67/140] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:55:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:55:55.464064 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc850d3d-8d60-4ddd-9511-5b688abe5b5c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:55.490794 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:55.620314 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc850d3d-8d60-4ddd-9511-5b688abe5b5c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:55.672817 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a438-959b-4ad8-9d20-763120e6d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:55.673777 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a438-959b-4ad8-9d20-763120e6d757 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:55.674219 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a438-959b-4ad8-9d20-763120e6d757 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:55.674666 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164a438-959b-4ad8-9d20-763120e6d757 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:55.675603 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a438-959b-4ad8-9d20-763120e6d757 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:55.676067 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a438-959b-4ad8-9d20-763120e6d757 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:55.677737 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164a438-959b-4ad8-9d20-763120e6d757 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:55.692931 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 74/141] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:55:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:55.701490 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0095e4-afe7-4ffb-90cc-063b37ce56fc None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:55.960808 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0095e4-afe7-4ffb-90cc-063b37ce56fc None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:56.034480 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb392792-ba6a-4c26-953a-7003b676011e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:56.036091 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392792-ba6a-4c26-953a-7003b676011e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:56.036634 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392792-ba6a-4c26-953a-7003b676011e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:56.037145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb392792-ba6a-4c26-953a-7003b676011e None admin] PATH_INFO: `/v3/users/c037cea25a404f0783e6ef90b07a1769` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:56.039530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb392792-ba6a-4c26-953a-7003b676011e None admin] RBAC: Authorizing `identity:get_user(user_id=c037cea25a404f0783e6ef90b07a1769)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:56.042442 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb392792-ba6a-4c26-953a-7003b676011e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:56.046330 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 68/142] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:55 2022] GET /identity/v3/users/c037cea25a404f0783e6ef90b07a1769 => generated 275 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:56.057315 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a438-959b-4ad8-9d20-763120e6d757 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:56.063596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad218c-60fe-4997-9eb7-9b16c581a3b5 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:56.064102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad218c-60fe-4997-9eb7-9b16c581a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:56.064680 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ad218c-60fe-4997-9eb7-9b16c581a3b5 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:56.067686 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 69/143] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:56.076511 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd9eba-54ab-41bb-86b0-1c2b02ade249 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:56.077110 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd9eba-54ab-41bb-86b0-1c2b02ade249 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:56.077594 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bd9eba-54ab-41bb-86b0-1c2b02ade249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:56.111701 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-92bd9eba-54ab-41bb-86b0-1c2b02ade249 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:56.113815 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-92bd9eba-54ab-41bb-86b0-1c2b02ade249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:56.216206 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:56.254447 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:56.267470 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 70/144] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:55:56.328273 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164a438-959b-4ad8-9d20-763120e6d757 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:56.394213 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd9eba-54ab-41bb-86b0-1c2b02ade249 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:56.457364 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5251cf43-b403-4d1c-b286-a62592041565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:56.458514 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251cf43-b403-4d1c-b286-a62592041565 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:56.459016 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251cf43-b403-4d1c-b286-a62592041565 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:56.459496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5251cf43-b403-4d1c-b286-a62592041565 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:56.707360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251cf43-b403-4d1c-b286-a62592041565 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:56.710365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5251cf43-b403-4d1c-b286-a62592041565 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:56.719293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bd9eba-54ab-41bb-86b0-1c2b02ade249 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:56.849103 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553c579c-591d-4b22-9ff1-172bca28426d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:56.851440 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c579c-591d-4b22-9ff1-172bca28426d None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:56.851967 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c579c-591d-4b22-9ff1-172bca28426d None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:56.852458 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553c579c-591d-4b22-9ff1-172bca28426d None admin] PATH_INFO: `/v3/domains/default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:56.861196 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c579c-591d-4b22-9ff1-172bca28426d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:56.862821 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553c579c-591d-4b22-9ff1-172bca28426d None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:56.865963 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 71/145] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:55:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:56.868513 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b18e8-15ee-4e9c-91b8-1d423ec378fc None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:56.870571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b18e8-15ee-4e9c-91b8-1d423ec378fc None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:56.870571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b18e8-15ee-4e9c-91b8-1d423ec378fc None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:56.871341 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 72/146] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:56.879461 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b18e8-15ee-4e9c-91b8-1d423ec378fc None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:56.958338 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:57.020337 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 75/147] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:55:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 963 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:55:57.021828 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a481b-c7dc-4543-94eb-17bf3acbb783 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:57.022029 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a481b-c7dc-4543-94eb-17bf3acbb783 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:57.022292 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a481b-c7dc-4543-94eb-17bf3acbb783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:57.027998 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:57.063384 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-fc8a481b-c7dc-4543-94eb-17bf3acbb783 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:57.064714 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-fc8a481b-c7dc-4543-94eb-17bf3acbb783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:57.124964 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b18e8-15ee-4e9c-91b8-1d423ec378fc None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:57.200142 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f1e51-b86c-482a-9902-a47a35b9590a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:57.200885 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f1e51-b86c-482a-9902-a47a35b9590a None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:57.201722 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f1e51-b86c-482a-9902-a47a35b9590a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:57.202007 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49f1e51-b86c-482a-9902-a47a35b9590a None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:57.202765 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f1e51-b86c-482a-9902-a47a35b9590a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:57.204292 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49f1e51-b86c-482a-9902-a47a35b9590a None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:57.215176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 76/148] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:57.216467 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a481b-c7dc-4543-94eb-17bf3acbb783 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:57.276181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 73/149] 10.222.0.25 () {60 vars in 1132 bytes} [Wed May 25 07:55:56 2022] POST /identity/v3/users => generated 283 bytes in 397 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:55:57.276181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f1e51-b86c-482a-9902-a47a35b9590a None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:57.500080 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a481b-c7dc-4543-94eb-17bf3acbb783 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:57.515891 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:57.560257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49f1e51-b86c-482a-9902-a47a35b9590a None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:57.574991 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac570d-43ec-452c-95f4-4c6393d7e131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:57.576008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac570d-43ec-452c-95f4-4c6393d7e131 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:57.576327 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac570d-43ec-452c-95f4-4c6393d7e131 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:57.576611 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac570d-43ec-452c-95f4-4c6393d7e131 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:57.578042 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac570d-43ec-452c-95f4-4c6393d7e131 None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:57.579605 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac570d-43ec-452c-95f4-4c6393d7e131 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:57.581509 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 77/150] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:55:57 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:57.589255 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:57.590557 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac570d-43ec-452c-95f4-4c6393d7e131 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:57.639543 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84f378-7549-4dc5-a930-4deef53d7478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:57.641893 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84f378-7549-4dc5-a930-4deef53d7478 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:57.643045 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84f378-7549-4dc5-a930-4deef53d7478 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:57.643922 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba84f378-7549-4dc5-a930-4deef53d7478 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:57.667069 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba84f378-7549-4dc5-a930-4deef53d7478 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-ba84f378-7549-4dc5-a930-4deef53d7478 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:57.684294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:57.686038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:57.687564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:57.687564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:57.687564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:57.687564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:57.687564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:57.687564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:57.687564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:57.687564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:57.687564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:57.687564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:57.687564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:55:57.687564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:55:57.692102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 74/151] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:55:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 418 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:55:57.699090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84f378-7549-4dc5-a930-4deef53d7478 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:57.847482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac570d-43ec-452c-95f4-4c6393d7e131 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:57.960538 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba84f378-7549-4dc5-a930-4deef53d7478 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:57.975127 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975bb40-d9d8-4858-aa24-0c5ccb64814d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:57.975811 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975bb40-d9d8-4858-aa24-0c5ccb64814d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:57.976092 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975bb40-d9d8-4858-aa24-0c5ccb64814d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:57.976482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1975bb40-d9d8-4858-aa24-0c5ccb64814d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:57.977341 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975bb40-d9d8-4858-aa24-0c5ccb64814d None admin] RBAC: Adding query filter params (role.id=0e5f3c37f30e45da98262a20b891833d, scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b, user.id=c037cea25a404f0783e6ef90b07a1769) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:57.977653 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975bb40-d9d8-4858-aa24-0c5ccb64814d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:57.979404 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1975bb40-d9d8-4858-aa24-0c5ccb64814d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:57.995707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 78/152] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:55:57 2022] GET /identity/v3/role_assignments?user.id=c037cea25a404f0783e6ef90b07a1769&scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b&role.id=0e5f3c37f30e45da98262a20b891833d => generated 608 bytes in 406 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:55:58.038163 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902c4298-bcdd-46ca-a05b-4f5d6d2cc443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:58.040095 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c4298-bcdd-46ca-a05b-4f5d6d2cc443 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:58.040809 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c4298-bcdd-46ca-a05b-4f5d6d2cc443 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:58.041493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902c4298-bcdd-46ca-a05b-4f5d6d2cc443 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:58.042988 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c4298-bcdd-46ca-a05b-4f5d6d2cc443 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:58.043874 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c4298-bcdd-46ca-a05b-4f5d6d2cc443 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:58.046888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902c4298-bcdd-46ca-a05b-4f5d6d2cc443 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:58.064755 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 75/153] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:55:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:58.073737 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975bb40-d9d8-4858-aa24-0c5ccb64814d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:58.144315 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:58.235099 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1975bb40-d9d8-4858-aa24-0c5ccb64814d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:58.263174 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17229c-b9bc-4007-821e-a724ef098bab None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:58.264685 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17229c-b9bc-4007-821e-a724ef098bab None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:58.265630 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c17229c-b9bc-4007-821e-a724ef098bab None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:58.277634 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 76/154] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:58 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:58.286404 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a49ce-af5d-431e-bb36-c76e71ca67c6 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:58.287358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a49ce-af5d-431e-bb36-c76e71ca67c6 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:58.288181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20a49ce-af5d-431e-bb36-c76e71ca67c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:58.288723 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55b38e-f5c3-4e47-ae22-b4878e69f932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:58.289653 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55b38e-f5c3-4e47-ae22-b4878e69f932 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:58.289937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55b38e-f5c3-4e47-ae22-b4878e69f932 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:58.290216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c55b38e-f5c3-4e47-ae22-b4878e69f932 None admin] PATH_INFO: `/v3/users/945bb5172fb64c3a9a54077b32240aed` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:58.291663 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55b38e-f5c3-4e47-ae22-b4878e69f932 None admin] RBAC: Authorizing `identity:get_user(user_id=945bb5172fb64c3a9a54077b32240aed)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:58.296156 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c55b38e-f5c3-4e47-ae22-b4878e69f932 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:58.296156 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 79/155] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:58 2022] GET /identity/v3/users/945bb5172fb64c3a9a54077b32240aed => generated 247 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:58.303361 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55b38e-f5c3-4e47-ae22-b4878e69f932 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:58.347403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-b20a49ce-af5d-431e-bb36-c76e71ca67c6 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:58.350208 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-b20a49ce-af5d-431e-bb36-c76e71ca67c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:58.439303 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:58.462053 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c55b38e-f5c3-4e47-ae22-b4878e69f932 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:58.471433 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:58.521262 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb86a9-790c-4c9d-b325-cab314ad5567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:58.521956 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb86a9-790c-4c9d-b325-cab314ad5567 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:58.522244 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb86a9-790c-4c9d-b325-cab314ad5567 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:58.522527 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcb86a9-790c-4c9d-b325-cab314ad5567 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:58.537618 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 77/156] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:58.594505 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a49ce-af5d-431e-bb36-c76e71ca67c6 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:58.616156 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb86a9-790c-4c9d-b325-cab314ad5567 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:58.616156 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcb86a9-790c-4c9d-b325-cab314ad5567 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:58.846412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 80/157] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:55:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:55:58.860056 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb86a9-790c-4c9d-b325-cab314ad5567 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:58.904169 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:58.979407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20a49ce-af5d-431e-bb36-c76e71ca67c6 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:59.135326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9f867-e8f6-4d18-803a-6fadb2ff0700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:59.136701 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9f867-e8f6-4d18-803a-6fadb2ff0700 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:59.137196 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9f867-e8f6-4d18-803a-6fadb2ff0700 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:59.137690 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9f867-e8f6-4d18-803a-6fadb2ff0700 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:59.185258 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9f867-e8f6-4d18-803a-6fadb2ff0700 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-f5e9f867-e8f6-4d18-803a-6fadb2ff0700 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:55:59.218337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:55:59.219279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:55:59.220066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:55:59.220066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:55:59.220066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:55:59.220066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:55:59.220066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:55:59.220066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:55:59.220066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:55:59.220066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:55:59.220066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:55:59.220066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:55:59.220066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:55:59.220066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:55:59.227675 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 78/158] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:55:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 634 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:55:59.229043 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7f5b8-2315-45b2-920f-49c20e599c87 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:59.229326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7f5b8-2315-45b2-920f-49c20e599c87 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:59.236425 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7f5b8-2315-45b2-920f-49c20e599c87 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:59.237962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 79/159] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:55:59 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:55:59.242430 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7f5b8-2315-45b2-920f-49c20e599c87 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:59.246128 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcb86a9-790c-4c9d-b325-cab314ad5567 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:59.300151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da203acc-b7ad-423f-9d72-51b2ac5a2c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:59.306811 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da203acc-b7ad-423f-9d72-51b2ac5a2c9f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:59.308154 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da203acc-b7ad-423f-9d72-51b2ac5a2c9f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:59.308154 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da203acc-b7ad-423f-9d72-51b2ac5a2c9f None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:59.313537 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da203acc-b7ad-423f-9d72-51b2ac5a2c9f None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:59.316320 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da203acc-b7ad-423f-9d72-51b2ac5a2c9f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:59.323307 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 81/160] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:55:58 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 464 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:59.328275 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0338f-4303-43ae-b942-c0389a9afed8 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:59.333121 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:59.335149 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0338f-4303-43ae-b942-c0389a9afed8 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:59.335288 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc0338f-4303-43ae-b942-c0389a9afed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:59.370427 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-6bc0338f-4303-43ae-b942-c0389a9afed8 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:55:59.380166 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-6bc0338f-4303-43ae-b942-c0389a9afed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:55:59.550358 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 82/161] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:55:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:55:59.552604 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0338f-4303-43ae-b942-c0389a9afed8 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:59.569458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:55:59.608856 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7f5b8-2315-45b2-920f-49c20e599c87 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:59.696386 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588eaf7f-96b0-4e4a-814a-0dd703ca186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:59.697077 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588eaf7f-96b0-4e4a-814a-0dd703ca186a None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:59.697368 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588eaf7f-96b0-4e4a-814a-0dd703ca186a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:59.697651 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588eaf7f-96b0-4e4a-814a-0dd703ca186a None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:59.698415 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588eaf7f-96b0-4e4a-814a-0dd703ca186a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:59.698729 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588eaf7f-96b0-4e4a-814a-0dd703ca186a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:59.700295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588eaf7f-96b0-4e4a-814a-0dd703ca186a None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:59.723931 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 80/162] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:55:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:59.724847 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588eaf7f-96b0-4e4a-814a-0dd703ca186a None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:59.798136 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc0338f-4303-43ae-b942-c0389a9afed8 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:55:59.881601 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b9303-b157-4447-ba52-5c419134c9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:55:59.882581 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b9303-b157-4447-ba52-5c419134c9da None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:55:59.882581 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b9303-b157-4447-ba52-5c419134c9da None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:55:59.882871 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0b9303-b157-4447-ba52-5c419134c9da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:55:59.883687 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b9303-b157-4447-ba52-5c419134c9da None admin] RBAC: Adding query filter params (role.id=5c1382efdc2e4eebaf5f15a4cdae58e0, scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b, user.id=945bb5172fb64c3a9a54077b32240aed) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:55:59.888110 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b9303-b157-4447-ba52-5c419134c9da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:55:59.890321 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0b9303-b157-4447-ba52-5c419134c9da None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:55:59.899683 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 83/163] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:55:59 2022] GET /identity/v3/role_assignments?user.id=945bb5172fb64c3a9a54077b32240aed&scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b&role.id=5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 608 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:55:59.902837 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b9303-b157-4447-ba52-5c419134c9da None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:55:59.977896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:00.023995 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588eaf7f-96b0-4e4a-814a-0dd703ca186a None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:00.080578 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:00.124855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b359140-b548-464b-adcd-19a8b036f406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:00.125761 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b359140-b548-464b-adcd-19a8b036f406 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:00.126051 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b359140-b548-464b-adcd-19a8b036f406 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:00.126958 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b359140-b548-464b-adcd-19a8b036f406 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:00.153697 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b359140-b548-464b-adcd-19a8b036f406 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-2b359140-b548-464b-adcd-19a8b036f406 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:00.162145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:00.163888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:00.165527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:00.165527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:00.165527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:00.165527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:00.165527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:00.165527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:00.165527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:00.165527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:00.165527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:00.165527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:00.165527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:00.165527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:00.178759 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0b9303-b157-4447-ba52-5c419134c9da None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:00.180934 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 81/164] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:55:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 452 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:00.182542 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645c07b-359d-4c66-9872-8dc1679397d2 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:00.182834 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645c07b-359d-4c66-9872-8dc1679397d2 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:00.183114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e645c07b-359d-4c66-9872-8dc1679397d2 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:00.184593 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 82/165] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:00.185446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645c07b-359d-4c66-9872-8dc1679397d2 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:00.259025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4526d5-2e30-48a2-b045-622f5266ee0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:00.259992 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4526d5-2e30-48a2-b045-622f5266ee0b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:00.260291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4526d5-2e30-48a2-b045-622f5266ee0b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:00.260576 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4526d5-2e30-48a2-b045-622f5266ee0b None admin] PATH_INFO: `/v3/users/c037cea25a404f0783e6ef90b07a1769` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:00.262461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4526d5-2e30-48a2-b045-622f5266ee0b None admin] RBAC: Authorizing `identity:get_user(user_id=c037cea25a404f0783e6ef90b07a1769)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:00.264648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4526d5-2e30-48a2-b045-622f5266ee0b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:00.266670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 84/166] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:55:59 2022] GET /identity/v3/users/c037cea25a404f0783e6ef90b07a1769 => generated 275 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:00.268902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e14a77-cd05-44bf-9555-adf70badc73c None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:00.268902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e14a77-cd05-44bf-9555-adf70badc73c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:00.268902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e14a77-cd05-44bf-9555-adf70badc73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:00.322558 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-59e14a77-cd05-44bf-9555-adf70badc73c None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:00.323822 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-59e14a77-cd05-44bf-9555-adf70badc73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:00.416923 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e645c07b-359d-4c66-9872-8dc1679397d2 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:00.525863 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23ae12-e345-4846-99c4-501fddf15575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:00.527362 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23ae12-e345-4846-99c4-501fddf15575 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:00.527880 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23ae12-e345-4846-99c4-501fddf15575 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:00.528418 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf23ae12-e345-4846-99c4-501fddf15575 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:00.532592 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23ae12-e345-4846-99c4-501fddf15575 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:00.533121 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23ae12-e345-4846-99c4-501fddf15575 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:00.535911 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf23ae12-e345-4846-99c4-501fddf15575 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:00.563018 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 83/167] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:00.563237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 85/168] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:00.568178 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e14a77-cd05-44bf-9555-adf70badc73c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:00.584951 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23ae12-e345-4846-99c4-501fddf15575 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:00.610533 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:00.717193 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:00.792434 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf23ae12-e345-4846-99c4-501fddf15575 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:00.821272 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e14a77-cd05-44bf-9555-adf70badc73c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:00.849994 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c321d-0294-437f-98b7-ab52f3dfc84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:00.852174 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c321d-0294-437f-98b7-ab52f3dfc84e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:00.852721 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c321d-0294-437f-98b7-ab52f3dfc84e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:00.853204 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730c321d-0294-437f-98b7-ab52f3dfc84e None admin] PATH_INFO: `/v3/users/2db4ceecad9e4f9b9314d562ea48bbf5` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:00.854900 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c321d-0294-437f-98b7-ab52f3dfc84e None admin] RBAC: Authorizing `identity:get_user(user_id=2db4ceecad9e4f9b9314d562ea48bbf5)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:00.856691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730c321d-0294-437f-98b7-ab52f3dfc84e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:00.859453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 84/169] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:00 2022] GET /identity/v3/users/2db4ceecad9e4f9b9314d562ea48bbf5 => generated 289 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:00.860550 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c321d-0294-437f-98b7-ab52f3dfc84e None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:00.901400 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e7b44-0148-4ff9-b6d3-39c81854cde9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:00.907861 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e7b44-0148-4ff9-b6d3-39c81854cde9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:00.908521 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e7b44-0148-4ff9-b6d3-39c81854cde9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:00.909001 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e7b44-0148-4ff9-b6d3-39c81854cde9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:01.031118 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:01.053286 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e7b44-0148-4ff9-b6d3-39c81854cde9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:01.056348 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195e7b44-0148-4ff9-b6d3-39c81854cde9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:01.097183 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730c321d-0294-437f-98b7-ab52f3dfc84e None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:01.195928 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a5d87-a51b-4067-bab3-4cbed748723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:01.196939 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a5d87-a51b-4067-bab3-4cbed748723c None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:01.197118 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a5d87-a51b-4067-bab3-4cbed748723c None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:01.197507 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837a5d87-a51b-4067-bab3-4cbed748723c None admin] PATH_INFO: `/v3/roles/member` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:01.223773 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:01.224567 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837a5d87-a51b-4067-bab3-4cbed748723c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-837a5d87-a51b-4067-bab3-4cbed748723c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:01.236883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:01.238867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 85/170] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:01.240578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a5d87-a51b-4067-bab3-4cbed748723c None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:01.301481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 86/171] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 738 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:01.311480 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e7b44-0148-4ff9-b6d3-39c81854cde9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:01.395423 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837a5d87-a51b-4067-bab3-4cbed748723c None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:01.436836 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e3e4-72fd-4c76-be12-04f7116fb757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:01.437724 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e3e4-72fd-4c76-be12-04f7116fb757 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:01.438009 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e3e4-72fd-4c76-be12-04f7116fb757 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:01.438290 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367e3e4-72fd-4c76-be12-04f7116fb757 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:01.440491 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367e3e4-72fd-4c76-be12-04f7116fb757 None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:01.441989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367e3e4-72fd-4c76-be12-04f7116fb757 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:01.445502 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 86/172] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:01 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:01.446342 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e3e4-72fd-4c76-be12-04f7116fb757 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:01.464699 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:01.532530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195e7b44-0148-4ff9-b6d3-39c81854cde9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:01.611645 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757789bf-83ba-41e0-8cd5-740a4cd09c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:01.612369 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757789bf-83ba-41e0-8cd5-740a4cd09c8c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:01.612656 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757789bf-83ba-41e0-8cd5-740a4cd09c8c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:01.612936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757789bf-83ba-41e0-8cd5-740a4cd09c8c None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:01.613704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757789bf-83ba-41e0-8cd5-740a4cd09c8c None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:01.614011 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757789bf-83ba-41e0-8cd5-740a4cd09c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:01.615425 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757789bf-83ba-41e0-8cd5-740a4cd09c8c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:01.644596 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 87/173] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:01.645952 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757789bf-83ba-41e0-8cd5-740a4cd09c8c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:01.656166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367e3e4-72fd-4c76-be12-04f7116fb757 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:01.693006 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7e111-ab2e-4e10-bdf8-42f9ba57cb96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:01.693886 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7e111-ab2e-4e10-bdf8-42f9ba57cb96 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:01.694231 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7e111-ab2e-4e10-bdf8-42f9ba57cb96 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:01.694511 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e7e111-ab2e-4e10-bdf8-42f9ba57cb96 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:01.695830 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7e111-ab2e-4e10-bdf8-42f9ba57cb96 None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:01.697379 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e7e111-ab2e-4e10-bdf8-42f9ba57cb96 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:01.699495 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 87/174] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:01 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:01.700348 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7e111-ab2e-4e10-bdf8-42f9ba57cb96 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:01.712500 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:01.782496 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:01.818846 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e7e111-ab2e-4e10-bdf8-42f9ba57cb96 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:01.860419 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfff82-b25d-46f6-b236-823f44ddfd23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:01.861863 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfff82-b25d-46f6-b236-823f44ddfd23 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:01.862396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfff82-b25d-46f6-b236-823f44ddfd23 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:01.862882 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ccfff82-b25d-46f6-b236-823f44ddfd23 None admin] PATH_INFO: `/v3/users/c037cea25a404f0783e6ef90b07a1769` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:01.864650 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfff82-b25d-46f6-b236-823f44ddfd23 None admin] RBAC: Authorizing `identity:get_user(user_id=c037cea25a404f0783e6ef90b07a1769)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:01.866441 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ccfff82-b25d-46f6-b236-823f44ddfd23 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:01.868521 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 88/175] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:01 2022] GET /identity/v3/users/c037cea25a404f0783e6ef90b07a1769 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:01.869621 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfff82-b25d-46f6-b236-823f44ddfd23 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:01.911026 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757789bf-83ba-41e0-8cd5-740a4cd09c8c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:01.967379 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b624af6-8923-4f68-b2ec-9b0a714a84c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:01.968321 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b624af6-8923-4f68-b2ec-9b0a714a84c8 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:01.968613 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b624af6-8923-4f68-b2ec-9b0a714a84c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:01.968894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b624af6-8923-4f68-b2ec-9b0a714a84c8 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b/users/2db4ceecad9e4f9b9314d562ea48bbf5/roles/040d082ba25f428a898a87057e2f7341` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:01.971078 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b624af6-8923-4f68-b2ec-9b0a714a84c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b49bdd94998e4f67af5ef2d3eb963c3b, user_id=2db4ceecad9e4f9b9314d562ea48bbf5, role_id=040d082ba25f428a898a87057e2f7341)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:01.972638 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b624af6-8923-4f68-b2ec-9b0a714a84c8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:01.991194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 88/176] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:56:01 2022] PUT /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b/users/2db4ceecad9e4f9b9314d562ea48bbf5/roles/040d082ba25f428a898a87057e2f7341 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:56:01.992145 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b624af6-8923-4f68-b2ec-9b0a714a84c8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:01.997701 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ccfff82-b25d-46f6-b236-823f44ddfd23 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:02.070082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef954b51-0b61-483c-b330-996002d9c040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:02.070762 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef954b51-0b61-483c-b330-996002d9c040 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:02.071050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef954b51-0b61-483c-b330-996002d9c040 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:02.077738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef954b51-0b61-483c-b330-996002d9c040 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:02.088873 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef954b51-0b61-483c-b330-996002d9c040 None admin] RBAC: Adding query filter params (role.id=fb458495153d4239becfaff1b68b012e, scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b, user.id=c037cea25a404f0783e6ef90b07a1769) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:02.089277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef954b51-0b61-483c-b330-996002d9c040 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:02.090765 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef954b51-0b61-483c-b330-996002d9c040 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:02.106734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 89/177] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:56:01 2022] GET /identity/v3/role_assignments?user.id=c037cea25a404f0783e6ef90b07a1769&scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b&role.id=fb458495153d4239becfaff1b68b012e => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:02.108770 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4034f5-ce3e-4f13-a8e6-5fa676d31b30 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:02.109080 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4034f5-ce3e-4f13-a8e6-5fa676d31b30 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:02.109339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4034f5-ce3e-4f13-a8e6-5fa676d31b30 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:02.110375 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:02.110968 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 90/178] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:02.119278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d9c1b-9865-4495-bf03-437e760e27c0 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:02.119506 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d9c1b-9865-4495-bf03-437e760e27c0 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:02.119853 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116d9c1b-9865-4495-bf03-437e760e27c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:02.129393 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:02.150081 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b624af6-8923-4f68-b2ec-9b0a714a84c8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:02.150349 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-116d9c1b-9865-4495-bf03-437e760e27c0 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:02.151654 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-116d9c1b-9865-4495-bf03-437e760e27c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:02.282094 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 91/179] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:02.314639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59309e-05bd-4be0-aded-f4dda7645b10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:02.316933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59309e-05bd-4be0-aded-f4dda7645b10 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:02.317712 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59309e-05bd-4be0-aded-f4dda7645b10 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:02.318454 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd59309e-05bd-4be0-aded-f4dda7645b10 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:02.324161 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f314be-6eb7-4e47-8931-757e2ffa0ed0 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:02.324161 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f314be-6eb7-4e47-8931-757e2ffa0ed0 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:02.324161 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f314be-6eb7-4e47-8931-757e2ffa0ed0 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:02.324873 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 92/180] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:02.333075 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f489586-819e-45bb-9d2c-a3a6abc3a4c0 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:02.333529 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f489586-819e-45bb-9d2c-a3a6abc3a4c0 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:02.333959 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f489586-819e-45bb-9d2c-a3a6abc3a4c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:02.366642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-8f489586-819e-45bb-9d2c-a3a6abc3a4c0 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:02.367955 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-8f489586-819e-45bb-9d2c-a3a6abc3a4c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:02.524183 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59309e-05bd-4be0-aded-f4dda7645b10 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:02.526943 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd59309e-05bd-4be0-aded-f4dda7645b10 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:02.532047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 93/181] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:02.535647 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f489586-819e-45bb-9d2c-a3a6abc3a4c0 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:02.662346 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:02.714043 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:02.737903 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 89/182] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 746 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:02.739099 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59309e-05bd-4be0-aded-f4dda7645b10 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:02.752040 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f489586-819e-45bb-9d2c-a3a6abc3a4c0 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:02.814525 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca7699-68b9-4eb9-b609-2e5e5797bf1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:02.816453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca7699-68b9-4eb9-b609-2e5e5797bf1e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:02.816874 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca7699-68b9-4eb9-b609-2e5e5797bf1e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:02.817355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca7699-68b9-4eb9-b609-2e5e5797bf1e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:02.839034 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca7699-68b9-4eb9-b609-2e5e5797bf1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-48ca7699-68b9-4eb9-b609-2e5e5797bf1e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:02.854417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:02.856229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 94/183] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:56:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:02.863242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d7c50-9115-4f5e-9a4a-87d547f4fc62 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:02.863952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d7c50-9115-4f5e-9a4a-87d547f4fc62 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:02.863952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173d7c50-9115-4f5e-9a4a-87d547f4fc62 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:02.863952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 95/184] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:02.864734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d7c50-9115-4f5e-9a4a-87d547f4fc62 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:02.905217 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd59309e-05bd-4be0-aded-f4dda7645b10 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:02.965052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a921239-1d1b-43e7-9f25-71df3ed04adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:02.966181 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a921239-1d1b-43e7-9f25-71df3ed04adb None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:02.966479 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a921239-1d1b-43e7-9f25-71df3ed04adb None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:02.966932 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a921239-1d1b-43e7-9f25-71df3ed04adb None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:02.968904 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a921239-1d1b-43e7-9f25-71df3ed04adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:02.971240 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a921239-1d1b-43e7-9f25-71df3ed04adb None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:02.973972 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 90/185] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:56:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:02.975094 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a921239-1d1b-43e7-9f25-71df3ed04adb None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:03.086249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173d7c50-9115-4f5e-9a4a-87d547f4fc62 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:03.091248 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:03.142594 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:03.168418 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75934097-dfc4-465d-804b-74f49958ecc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:03.170116 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75934097-dfc4-465d-804b-74f49958ecc8 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:03.170631 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75934097-dfc4-465d-804b-74f49958ecc8 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:03.171135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75934097-dfc4-465d-804b-74f49958ecc8 None admin] PATH_INFO: `/v3/projects/d846beea108a41809d1cf07f5239e017` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:03.173666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75934097-dfc4-465d-804b-74f49958ecc8 None admin] RBAC: Authorizing `identity:get_project(project_id=d846beea108a41809d1cf07f5239e017)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:03.177091 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75934097-dfc4-465d-804b-74f49958ecc8 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:03.188815 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 96/186] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:02 2022] GET /identity/v3/projects/d846beea108a41809d1cf07f5239e017 => generated 312 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:03.191402 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e8bc1-7b0f-4ad0-a28a-427b2877ec75 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:03.192023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e8bc1-7b0f-4ad0-a28a-427b2877ec75 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:03.192574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e8bc1-7b0f-4ad0-a28a-427b2877ec75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:03.203819 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a921239-1d1b-43e7-9f25-71df3ed04adb None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:03.224544 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-005e8bc1-7b0f-4ad0-a28a-427b2877ec75 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:03.226794 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-005e8bc1-7b0f-4ad0-a28a-427b2877ec75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:03.294523 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd890d-5557-4034-8098-9ea3918ff925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:03.294523 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd890d-5557-4034-8098-9ea3918ff925 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:03.294523 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd890d-5557-4034-8098-9ea3918ff925 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:03.294523 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bd890d-5557-4034-8098-9ea3918ff925 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:03.298916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd890d-5557-4034-8098-9ea3918ff925 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:03.298916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd890d-5557-4034-8098-9ea3918ff925 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:03.298916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bd890d-5557-4034-8098-9ea3918ff925 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:03.323063 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 91/187] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:03.324331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd890d-5557-4034-8098-9ea3918ff925 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:03.358513 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 97/188] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:03.369646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e8bc1-7b0f-4ad0-a28a-427b2877ec75 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:03.507115 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bd890d-5557-4034-8098-9ea3918ff925 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:03.523526 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e8bc1-7b0f-4ad0-a28a-427b2877ec75 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:03.541457 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:03.556021 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:03.573463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa89f8-834c-420b-bcc8-4d0a113b1cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:03.574324 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa89f8-834c-420b-bcc8-4d0a113b1cde None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:03.574749 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa89f8-834c-420b-bcc8-4d0a113b1cde None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:03.575150 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaa89f8-834c-420b-bcc8-4d0a113b1cde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:03.576320 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa89f8-834c-420b-bcc8-4d0a113b1cde None admin] RBAC: Adding query filter params (role.id=0e5f3c37f30e45da98262a20b891833d, scope.project.id=d846beea108a41809d1cf07f5239e017, user.id=c037cea25a404f0783e6ef90b07a1769) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:03.576478 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442edfc-b101-443d-bfe6-82e2d09133fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:03.576839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa89f8-834c-420b-bcc8-4d0a113b1cde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:03.577582 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442edfc-b101-443d-bfe6-82e2d09133fc None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:03.578066 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442edfc-b101-443d-bfe6-82e2d09133fc None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:03.578535 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9442edfc-b101-443d-bfe6-82e2d09133fc None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:03.578802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaa89f8-834c-420b-bcc8-4d0a113b1cde None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:03.579800 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442edfc-b101-443d-bfe6-82e2d09133fc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:03.582100 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9442edfc-b101-443d-bfe6-82e2d09133fc None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:03.596593 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 98/189] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:56:03 2022] GET /identity/v3/role_assignments?user.id=c037cea25a404f0783e6ef90b07a1769&scope.project.id=d846beea108a41809d1cf07f5239e017&role.id=0e5f3c37f30e45da98262a20b891833d => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:03.596593 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa89f8-834c-420b-bcc8-4d0a113b1cde None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:03.625161 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 92/190] 10.222.0.25 () {60 vars in 1132 bytes} [Wed May 25 07:56:03 2022] POST /identity/v3/users => generated 297 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:56:03.626586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442edfc-b101-443d-bfe6-82e2d09133fc None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:03.892175 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaa89f8-834c-420b-bcc8-4d0a113b1cde None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:03.971472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d170104-fa3c-4344-96c3-42fc03f7a8ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:03.975602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d170104-fa3c-4344-96c3-42fc03f7a8ac None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:03.976270 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d170104-fa3c-4344-96c3-42fc03f7a8ac None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:03.976731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d170104-fa3c-4344-96c3-42fc03f7a8ac None admin] PATH_INFO: `/v3/users/9a92f621defc404f9041f6636e268c5e` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:03.989220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9442edfc-b101-443d-bfe6-82e2d09133fc None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:04.011830 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d170104-fa3c-4344-96c3-42fc03f7a8ac None admin] RBAC: Authorizing `identity:get_user(user_id=9a92f621defc404f9041f6636e268c5e)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:04.015629 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d170104-fa3c-4344-96c3-42fc03f7a8ac None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:04.019583 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 99/191] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:03 2022] GET /identity/v3/users/9a92f621defc404f9041f6636e268c5e => generated 283 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:04.029688 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d170104-fa3c-4344-96c3-42fc03f7a8ac None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:04.065110 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f2601-d4a1-472c-aedf-ee878345c7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:04.066722 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f2601-d4a1-472c-aedf-ee878345c7c1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:04.067025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f2601-d4a1-472c-aedf-ee878345c7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:04.067523 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f2601-d4a1-472c-aedf-ee878345c7c1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:04.094296 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f2601-d4a1-472c-aedf-ee878345c7c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-569f2601-d4a1-472c-aedf-ee878345c7c1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:04.110705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:04.111646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:04.112476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:04.112476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:04.112476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:04.112476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:04.112476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:04.112476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:04.112476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:04.112476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:04.112476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:04.112476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:04.112476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:04.112476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:04.114692 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 93/192] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:56:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 489 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:04.124262 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f2601-d4a1-472c-aedf-ee878345c7c1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:04.136889 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:04.190160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:04.234351 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d170104-fa3c-4344-96c3-42fc03f7a8ac None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:04.308942 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e05cca-055c-435e-ae85-21013caf2583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:04.311403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e05cca-055c-435e-ae85-21013caf2583 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:04.311933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e05cca-055c-435e-ae85-21013caf2583 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:04.312426 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e05cca-055c-435e-ae85-21013caf2583 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:04.321753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f2601-d4a1-472c-aedf-ee878345c7c1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:04.408067 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f71d39-8268-4510-bcde-82ed15a70238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:04.409184 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f71d39-8268-4510-bcde-82ed15a70238 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:04.409711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f71d39-8268-4510-bcde-82ed15a70238 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:04.410207 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f71d39-8268-4510-bcde-82ed15a70238 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:04.412411 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f71d39-8268-4510-bcde-82ed15a70238 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:04.412952 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f71d39-8268-4510-bcde-82ed15a70238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:04.416236 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f71d39-8268-4510-bcde-82ed15a70238 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:04.432872 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 94/193] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:56:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:04.434702 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e05cca-055c-435e-ae85-21013caf2583 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:04.436939 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e05cca-055c-435e-ae85-21013caf2583 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:04.442121 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f71d39-8268-4510-bcde-82ed15a70238 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:04.492494 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:04.576389 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 100/194] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 544 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:04.578850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e05cca-055c-435e-ae85-21013caf2583 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:04.693436 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e05cca-055c-435e-ae85-21013caf2583 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:04.734481 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3de9c81-3b70-4636-91cb-ce02acc56254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:04.735371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de9c81-3b70-4636-91cb-ce02acc56254 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:04.735653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de9c81-3b70-4636-91cb-ce02acc56254 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:04.735926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3de9c81-3b70-4636-91cb-ce02acc56254 None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:04.737317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de9c81-3b70-4636-91cb-ce02acc56254 None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:04.738895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3de9c81-3b70-4636-91cb-ce02acc56254 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:04.740791 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 101/195] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:04 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:04.743462 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:04.747957 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1a40a-30f6-4aee-9881-82bf8f2037e8 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:04.748400 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1a40a-30f6-4aee-9881-82bf8f2037e8 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:04.748688 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1a40a-30f6-4aee-9881-82bf8f2037e8 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:04.750326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 102/196] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:04.754731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1a40a-30f6-4aee-9881-82bf8f2037e8 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:04.757482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f71d39-8268-4510-bcde-82ed15a70238 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:04.768481 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:04.812154 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9b4ddd-4c98-445a-a619-4ba5b2576dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:04.813472 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b4ddd-4c98-445a-a619-4ba5b2576dc6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:04.813962 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b4ddd-4c98-445a-a619-4ba5b2576dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:04.814462 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9b4ddd-4c98-445a-a619-4ba5b2576dc6 None admin] PATH_INFO: `/v3/users/9a92f621defc404f9041f6636e268c5e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:04.816366 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b4ddd-4c98-445a-a619-4ba5b2576dc6 None admin] RBAC: Authorizing `identity:get_user(user_id=9a92f621defc404f9041f6636e268c5e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:04.818125 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9b4ddd-4c98-445a-a619-4ba5b2576dc6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:04.820629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 95/197] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:04 2022] GET /identity/v3/users/9a92f621defc404f9041f6636e268c5e => generated 283 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:04.823191 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70050-f643-4a3d-8125-373e342594f5 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:04.823867 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70050-f643-4a3d-8125-373e342594f5 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:04.824463 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f70050-f643-4a3d-8125-373e342594f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:04.845137 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-51f70050-f643-4a3d-8125-373e342594f5 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:04.846775 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-51f70050-f643-4a3d-8125-373e342594f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:04.889876 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1a40a-30f6-4aee-9881-82bf8f2037e8 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:04.930956 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 96/198] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:04.936307 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397aea5-fb96-4536-a2b5-521cd5f2e213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:04.936307 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397aea5-fb96-4536-a2b5-521cd5f2e213 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:04.936307 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397aea5-fb96-4536-a2b5-521cd5f2e213 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:04.936307 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397aea5-fb96-4536-a2b5-521cd5f2e213 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:04.936707 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397aea5-fb96-4536-a2b5-521cd5f2e213 None admin] RBAC: Adding query filter params (role.id=5c1382efdc2e4eebaf5f15a4cdae58e0, scope.project.id=6d09612017fd488a94e457afdcdec8a7, user.id=9a92f621defc404f9041f6636e268c5e) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:04.936707 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397aea5-fb96-4536-a2b5-521cd5f2e213 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:04.936827 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9397aea5-fb96-4536-a2b5-521cd5f2e213 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:04.938131 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70050-f643-4a3d-8125-373e342594f5 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:04.952451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 103/199] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:56:04 2022] GET /identity/v3/role_assignments?user.id=9a92f621defc404f9041f6636e268c5e&scope.project.id=6d09612017fd488a94e457afdcdec8a7&role.id=5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 259 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:04.998991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397aea5-fb96-4536-a2b5-521cd5f2e213 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:05.109072 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:05.137732 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9397aea5-fb96-4536-a2b5-521cd5f2e213 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:05.181772 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a0609-c0f7-4642-aeae-8210f562e018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:05.182965 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a0609-c0f7-4642-aeae-8210f562e018 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:05.183252 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a0609-c0f7-4642-aeae-8210f562e018 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:05.183528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a0609-c0f7-4642-aeae-8210f562e018 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:05.199151 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2a0609-c0f7-4642-aeae-8210f562e018 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-ef2a0609-c0f7-4642-aeae-8210f562e018 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:05.219264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:05.220225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:05.221032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:05.221032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:05.221032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:05.221032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:05.221032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:05.221032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:05.221032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:05.221032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:05.221032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:05.221032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:05.221032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:05.221032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:05.221032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 104/200] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:05.231427 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a0609-c0f7-4642-aeae-8210f562e018 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:05.252605 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:05.280715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f70050-f643-4a3d-8125-373e342594f5 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:05.383831 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa8106-b1b4-432c-bf0f-19fc42ba4506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:05.384820 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa8106-b1b4-432c-bf0f-19fc42ba4506 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:05.385108 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa8106-b1b4-432c-bf0f-19fc42ba4506 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:05.385388 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffa8106-b1b4-432c-bf0f-19fc42ba4506 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:05.462142 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a0609-c0f7-4642-aeae-8210f562e018 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:05.512035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa8106-b1b4-432c-bf0f-19fc42ba4506 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:05.515088 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffa8106-b1b4-432c-bf0f-19fc42ba4506 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:05.558689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb26869-8fd1-4109-9d97-3a97fc9b7db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:05.560499 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb26869-8fd1-4109-9d97-3a97fc9b7db8 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:05.561871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb26869-8fd1-4109-9d97-3a97fc9b7db8 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:05.563077 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb26869-8fd1-4109-9d97-3a97fc9b7db8 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:05.564275 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb26869-8fd1-4109-9d97-3a97fc9b7db8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:05.566098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb26869-8fd1-4109-9d97-3a97fc9b7db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:05.568812 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb26869-8fd1-4109-9d97-3a97fc9b7db8 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:05.574855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:05.591890 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 105/201] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:05.598380 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb26869-8fd1-4109-9d97-3a97fc9b7db8 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:05.728667 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:05.741947 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 97/202] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 804 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:05.751043 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa8106-b1b4-432c-bf0f-19fc42ba4506 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:05.833035 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb26869-8fd1-4109-9d97-3a97fc9b7db8 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:05.911867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a38bea-a5fa-48f3-a4fc-f5975df58b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:05.912802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38bea-a5fa-48f3-a4fc-f5975df58b95 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:05.913090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38bea-a5fa-48f3-a4fc-f5975df58b95 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:05.913372 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a38bea-a5fa-48f3-a4fc-f5975df58b95 None admin] PATH_INFO: `/v3/users/2db4ceecad9e4f9b9314d562ea48bbf5` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:05.918197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a38bea-a5fa-48f3-a4fc-f5975df58b95 None admin] RBAC: Authorizing `identity:get_user(user_id=2db4ceecad9e4f9b9314d562ea48bbf5)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:05.920367 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a38bea-a5fa-48f3-a4fc-f5975df58b95 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:05.922354 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 106/203] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:05 2022] GET /identity/v3/users/2db4ceecad9e4f9b9314d562ea48bbf5 => generated 289 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:05.927873 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a38bea-a5fa-48f3-a4fc-f5975df58b95 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:05.960567 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffa8106-b1b4-432c-bf0f-19fc42ba4506 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:06.041080 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:06.055976 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda55fe2-0599-4c7e-a738-3c8cb35c56aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:06.056990 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda55fe2-0599-4c7e-a738-3c8cb35c56aa None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:06.057278 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda55fe2-0599-4c7e-a738-3c8cb35c56aa None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:06.057607 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda55fe2-0599-4c7e-a738-3c8cb35c56aa None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:06.059014 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda55fe2-0599-4c7e-a738-3c8cb35c56aa None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:06.061134 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda55fe2-0599-4c7e-a738-3c8cb35c56aa None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:06.063185 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 98/204] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:05 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:06.071810 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda55fe2-0599-4c7e-a738-3c8cb35c56aa None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:06.116208 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a38bea-a5fa-48f3-a4fc-f5975df58b95 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:06.189971 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd02de-8879-4829-8206-5c9adbdc5355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:06.190665 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd02de-8879-4829-8206-5c9adbdc5355 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:06.190955 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd02de-8879-4829-8206-5c9adbdc5355 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:06.191239 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd02de-8879-4829-8206-5c9adbdc5355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:06.217112 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:06.340257 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda55fe2-0599-4c7e-a738-3c8cb35c56aa None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:06.346174 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd02de-8879-4829-8206-5c9adbdc5355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:06.349146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd02de-8879-4829-8206-5c9adbdc5355 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:06.437439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cc955-b277-4e05-9f05-8866736cdbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:06.438527 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cc955-b277-4e05-9f05-8866736cdbd1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:06.439049 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cc955-b277-4e05-9f05-8866736cdbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:06.439542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4cc955-b277-4e05-9f05-8866736cdbd1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:06.441269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cc955-b277-4e05-9f05-8866736cdbd1 None admin] RBAC: Adding query filter params (role.id=fb458495153d4239becfaff1b68b012e, scope.project.id=6d09612017fd488a94e457afdcdec8a7, user.id=9a92f621defc404f9041f6636e268c5e) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:06.441840 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cc955-b277-4e05-9f05-8866736cdbd1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:06.444732 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4cc955-b277-4e05-9f05-8866736cdbd1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:06.472774 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 99/205] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:56:06 2022] GET /identity/v3/role_assignments?user.id=9a92f621defc404f9041f6636e268c5e&scope.project.id=6d09612017fd488a94e457afdcdec8a7&role.id=fb458495153d4239becfaff1b68b012e => generated 259 bytes in 401 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:06.484307 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:06.562818 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 107/206] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 07:56:06.568886 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cc955-b277-4e05-9f05-8866736cdbd1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:06.752350 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4cc955-b277-4e05-9f05-8866736cdbd1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:06.822474 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:06.846200 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb082a7d-7114-45ab-8fa5-f30ca13208c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:06.847116 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb082a7d-7114-45ab-8fa5-f30ca13208c1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:06.847403 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb082a7d-7114-45ab-8fa5-f30ca13208c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:06.847685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb082a7d-7114-45ab-8fa5-f30ca13208c1 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:06.849100 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb082a7d-7114-45ab-8fa5-f30ca13208c1 None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:06.850631 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb082a7d-7114-45ab-8fa5-f30ca13208c1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:06.852892 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 100/207] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:06 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:06.859597 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd02de-8879-4829-8206-5c9adbdc5355 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:06.998269 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd02de-8879-4829-8206-5c9adbdc5355 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:07.052669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129645b-8b60-4349-a49e-61604700b693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:07.053805 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129645b-8b60-4349-a49e-61604700b693 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:07.054295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129645b-8b60-4349-a49e-61604700b693 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:07.054766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4129645b-8b60-4349-a49e-61604700b693 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:07.055807 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129645b-8b60-4349-a49e-61604700b693 None admin] RBAC: Adding query filter params (role.id=040d082ba25f428a898a87057e2f7341, scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b, user.id=2db4ceecad9e4f9b9314d562ea48bbf5) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:07.056444 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129645b-8b60-4349-a49e-61604700b693 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:07.058141 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4129645b-8b60-4349-a49e-61604700b693 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:07.062222 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d22bb1-17f8-49bc-8bd2-62e2f30a5c95 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:07.062222 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d22bb1-17f8-49bc-8bd2-62e2f30a5c95 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:07.062460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d22bb1-17f8-49bc-8bd2-62e2f30a5c95 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:07.063689 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 101/208] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:07.066393 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 108/209] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:56:06 2022] GET /identity/v3/role_assignments?user.id=2db4ceecad9e4f9b9314d562ea48bbf5&scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b&role.id=040d082ba25f428a898a87057e2f7341 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:07.085800 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2cffa-ee37-4154-b0a3-b31cd3d59d03 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:07.086117 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2cffa-ee37-4154-b0a3-b31cd3d59d03 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:07.086371 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e2cffa-ee37-4154-b0a3-b31cd3d59d03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:07.113999 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-a8e2cffa-ee37-4154-b0a3-b31cd3d59d03 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:07.115213 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a8e2cffa-ee37-4154-b0a3-b31cd3d59d03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:07.225263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 102/210] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:07.252655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129645b-8b60-4349-a49e-61604700b693 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:07.310423 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:07.425035 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4129645b-8b60-4349-a49e-61604700b693 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:07.496249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5146fa-3b0b-49e6-bee9-8bfc5984f7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:07.498374 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5146fa-3b0b-49e6-bee9-8bfc5984f7f1 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:07.498890 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5146fa-3b0b-49e6-bee9-8bfc5984f7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:07.499379 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5146fa-3b0b-49e6-bee9-8bfc5984f7f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:07.522567 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5146fa-3b0b-49e6-bee9-8bfc5984f7f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-ff5146fa-3b0b-49e6-bee9-8bfc5984f7f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:07.537596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:07.538564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:07.539339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:07.539339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:07.539339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:07.539339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:07.539339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:07.539339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:07.539339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:07.539339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:07.539339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:07.539339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:07.539339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:07.539339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:07.540526 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 109/211] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:56:07.546660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2cffa-ee37-4154-b0a3-b31cd3d59d03 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:07.728813 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d140d-ce9d-4b15-93b6-5fce7ea72748 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:07.729320 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d140d-ce9d-4b15-93b6-5fce7ea72748 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:07.729823 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d140d-ce9d-4b15-93b6-5fce7ea72748 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:07.733078 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 110/212] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:07.733308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e2cffa-ee37-4154-b0a3-b31cd3d59d03 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:07.741908 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc37fbb-9f93-4652-8ed3-9efbf7750a67 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:07.742242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc37fbb-9f93-4652-8ed3-9efbf7750a67 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:07.742613 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc37fbb-9f93-4652-8ed3-9efbf7750a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:07.764341 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:07.775885 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-6bc37fbb-9f93-4652-8ed3-9efbf7750a67 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:07.777499 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-6bc37fbb-9f93-4652-8ed3-9efbf7750a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:07.789443 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80be64-d720-48bf-abb9-14f4cd827a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:07.791350 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80be64-d720-48bf-abb9-14f4cd827a31 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:07.791859 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80be64-d720-48bf-abb9-14f4cd827a31 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:07.792391 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff80be64-d720-48bf-abb9-14f4cd827a31 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:07.795220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80be64-d720-48bf-abb9-14f4cd827a31 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:07.795806 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80be64-d720-48bf-abb9-14f4cd827a31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:07.798463 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff80be64-d720-48bf-abb9-14f4cd827a31 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:07.820740 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 103/213] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:07.826614 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80be64-d720-48bf-abb9-14f4cd827a31 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:07.916354 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 111/214] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:07.946080 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc37fbb-9f93-4652-8ed3-9efbf7750a67 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:07.990070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:08.003392 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff80be64-d720-48bf-abb9-14f4cd827a31 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:08.095934 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b721e-095c-4bde-97ee-60bf7fa500fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:08.097583 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b721e-095c-4bde-97ee-60bf7fa500fd None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:08.098361 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b721e-095c-4bde-97ee-60bf7fa500fd None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:08.098905 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6b721e-095c-4bde-97ee-60bf7fa500fd None admin] PATH_INFO: `/v3/users/5f0136e0d64b4a3c96c5f268e35af43c` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:08.125380 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b721e-095c-4bde-97ee-60bf7fa500fd None admin] RBAC: Authorizing `identity:get_user(user_id=5f0136e0d64b4a3c96c5f268e35af43c)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:08.128739 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6b721e-095c-4bde-97ee-60bf7fa500fd None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:08.132487 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 104/215] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:07 2022] GET /identity/v3/users/5f0136e0d64b4a3c96c5f268e35af43c => generated 297 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:08.142435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b721e-095c-4bde-97ee-60bf7fa500fd None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:08.175233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc37fbb-9f93-4652-8ed3-9efbf7750a67 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:08.237033 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:08.239422 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0668f-6595-483f-82a3-a5b50a778217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:08.243536 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0668f-6595-483f-82a3-a5b50a778217 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:08.244533 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0668f-6595-483f-82a3-a5b50a778217 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:08.244829 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d0668f-6595-483f-82a3-a5b50a778217 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:08.246180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0668f-6595-483f-82a3-a5b50a778217 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:08.247793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d0668f-6595-483f-82a3-a5b50a778217 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:08.249789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 112/216] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:56:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:08.255098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0668f-6595-483f-82a3-a5b50a778217 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:08.332987 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6b721e-095c-4bde-97ee-60bf7fa500fd None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:08.391224 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177368e-cba2-43bd-8e22-47d59847d776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:08.392521 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177368e-cba2-43bd-8e22-47d59847d776 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:08.392968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177368e-cba2-43bd-8e22-47d59847d776 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:08.393393 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177368e-cba2-43bd-8e22-47d59847d776 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:08.400821 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:08.422976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d0668f-6595-483f-82a3-a5b50a778217 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:08.480787 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7defb7-d348-475b-9dab-4cc4afed52bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:08.482539 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7defb7-d348-475b-9dab-4cc4afed52bc None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:08.482807 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177368e-cba2-43bd-8e22-47d59847d776 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:08.483153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7defb7-d348-475b-9dab-4cc4afed52bc None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:08.483571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7defb7-d348-475b-9dab-4cc4afed52bc None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:08.484491 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7defb7-d348-475b-9dab-4cc4afed52bc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:08.484799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177368e-cba2-43bd-8e22-47d59847d776 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:08.486387 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7defb7-d348-475b-9dab-4cc4afed52bc None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:08.515535 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 113/217] 10.222.0.25 () {60 vars in 1132 bytes} [Wed May 25 07:56:08 2022] POST /identity/v3/users => generated 297 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:56:08.558965 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:08.568058 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2ef5d-4e2d-4774-9304-5e361afbaf7a None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:08.568407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2ef5d-4e2d-4774-9304-5e361afbaf7a None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:08.571718 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd2ef5d-4e2d-4774-9304-5e361afbaf7a None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:08.571718 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 114/218] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:08.578022 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da400-e4b0-4b2f-99dc-d5766584a052 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:08.578325 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da400-e4b0-4b2f-99dc-d5766584a052 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:08.578579 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32da400-e4b0-4b2f-99dc-d5766584a052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:08.602339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-c32da400-e4b0-4b2f-99dc-d5766584a052 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:08.603716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-c32da400-e4b0-4b2f-99dc-d5766584a052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:08.646443 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 105/219] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 07:56:08.654061 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177368e-cba2-43bd-8e22-47d59847d776 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:08.704478 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 115/220] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:56:08.723904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32da400-e4b0-4b2f-99dc-d5766584a052 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:08.777926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177368e-cba2-43bd-8e22-47d59847d776 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:08.842305 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce66a3-d3d2-4cfa-8f2b-4c74705eaf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:08.843205 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce66a3-d3d2-4cfa-8f2b-4c74705eaf7d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:08.843487 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce66a3-d3d2-4cfa-8f2b-4c74705eaf7d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:08.843763 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cce66a3-d3d2-4cfa-8f2b-4c74705eaf7d None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:08.845297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce66a3-d3d2-4cfa-8f2b-4c74705eaf7d None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:08.846860 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cce66a3-d3d2-4cfa-8f2b-4c74705eaf7d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:08.849067 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 106/221] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:08 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:08.854982 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce66a3-d3d2-4cfa-8f2b-4c74705eaf7d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:08.855634 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:08.880551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:08.920036 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32da400-e4b0-4b2f-99dc-d5766584a052 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:08.984357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f698074-fd2c-4f94-b082-155469aaa08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:08.986165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f698074-fd2c-4f94-b082-155469aaa08a None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:08.986853 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f698074-fd2c-4f94-b082-155469aaa08a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:08.987520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f698074-fd2c-4f94-b082-155469aaa08a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:09.012641 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f698074-fd2c-4f94-b082-155469aaa08a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:09.024034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cce66a3-d3d2-4cfa-8f2b-4c74705eaf7d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-4f698074-fd2c-4f94-b082-155469aaa08a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:09.029883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:09.031061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:09.032532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:09.032532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:09.032532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:09.032532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:09.032532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:09.032532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:09.032532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:09.032532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:09.032532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:09.032532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:09.032532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:56:09.032532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:09.032532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 116/222] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:56:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:56:09.038524 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f698074-fd2c-4f94-b082-155469aaa08a None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:09.118646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd24e0-fab1-40b7-90ff-38650af596fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:09.119330 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd24e0-fab1-40b7-90ff-38650af596fc None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:09.119612 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd24e0-fab1-40b7-90ff-38650af596fc None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:09.119894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fd24e0-fab1-40b7-90ff-38650af596fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:09.120804 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd24e0-fab1-40b7-90ff-38650af596fc None admin] RBAC: Adding query filter params (role.id=0e5f3c37f30e45da98262a20b891833d, scope.project.id=6d09612017fd488a94e457afdcdec8a7, user.id=5f0136e0d64b4a3c96c5f268e35af43c) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:09.121122 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd24e0-fab1-40b7-90ff-38650af596fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:09.123250 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fd24e0-fab1-40b7-90ff-38650af596fc None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:09.131272 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 107/223] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:56:08 2022] GET /identity/v3/role_assignments?user.id=5f0136e0d64b4a3c96c5f268e35af43c&scope.project.id=6d09612017fd488a94e457afdcdec8a7&role.id=0e5f3c37f30e45da98262a20b891833d => generated 259 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:09.208956 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f698074-fd2c-4f94-b082-155469aaa08a None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:09.274124 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e6e106-483a-42f4-b076-1a68cf033778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:09.275223 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6e106-483a-42f4-b076-1a68cf033778 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:09.275663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6e106-483a-42f4-b076-1a68cf033778 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:09.276152 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e6e106-483a-42f4-b076-1a68cf033778 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:09.277429 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6e106-483a-42f4-b076-1a68cf033778 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:09.277886 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6e106-483a-42f4-b076-1a68cf033778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:09.280880 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e6e106-483a-42f4-b076-1a68cf033778 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:09.283279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:09.298179 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 117/224] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:09.305295 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd24e0-fab1-40b7-90ff-38650af596fc None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:09.394016 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bf2e1-bd6c-4c2c-902f-8215aa2e55d1 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:09.394337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bf2e1-bd6c-4c2c-902f-8215aa2e55d1 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:09.394593 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18bf2e1-bd6c-4c2c-902f-8215aa2e55d1 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:09.396372 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 118/225] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:56:09.417786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfa4ae-9550-4495-8b32-d8d601261f8d None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:09.418135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfa4ae-9550-4495-8b32-d8d601261f8d None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:09.418361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfa4ae-9550-4495-8b32-d8d601261f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:09.453576 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-bedfa4ae-9550-4495-8b32-d8d601261f8d None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:09.455003 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-bedfa4ae-9550-4495-8b32-d8d601261f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:09.461974 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:09.491874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fd24e0-fab1-40b7-90ff-38650af596fc None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:09.564517 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5bbfb-b6bd-432e-97de-1abd68764c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:09.565788 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5bbfb-b6bd-432e-97de-1abd68764c53 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:09.568518 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5bbfb-b6bd-432e-97de-1abd68764c53 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:09.569091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd5bbfb-b6bd-432e-97de-1abd68764c53 None admin] PATH_INFO: `/v3/users/9a92f621defc404f9041f6636e268c5e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:09.572731 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5bbfb-b6bd-432e-97de-1abd68764c53 None admin] RBAC: Authorizing `identity:get_user(user_id=9a92f621defc404f9041f6636e268c5e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:09.574596 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd5bbfb-b6bd-432e-97de-1abd68764c53 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:09.579959 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 108/226] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:09 2022] GET /identity/v3/users/9a92f621defc404f9041f6636e268c5e => generated 283 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:09.593478 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5bbfb-b6bd-432e-97de-1abd68764c53 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:09.596429 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 119/227] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:09.668849 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfa4ae-9550-4495-8b32-d8d601261f8d None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:09.783236 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd5bbfb-b6bd-432e-97de-1abd68764c53 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:09.851925 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45336-45cf-4def-a06d-7943219cea8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:09.853989 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45336-45cf-4def-a06d-7943219cea8c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:09.854778 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45336-45cf-4def-a06d-7943219cea8c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:09.855554 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af45336-45cf-4def-a06d-7943219cea8c None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:09.858185 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af45336-45cf-4def-a06d-7943219cea8c None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:09.861428 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af45336-45cf-4def-a06d-7943219cea8c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:09.865198 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 109/228] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:09 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:09.874937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45336-45cf-4def-a06d-7943219cea8c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:09.940795 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:09.978148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfa4ae-9550-4495-8b32-d8d601261f8d None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:10.057933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:10.097536 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76dbeb-96ad-4faa-9c49-0b41d7959b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:10.098380 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76dbeb-96ad-4faa-9c49-0b41d7959b67 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:10.098662 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76dbeb-96ad-4faa-9c49-0b41d7959b67 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:10.098946 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a76dbeb-96ad-4faa-9c49-0b41d7959b67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:10.105574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af45336-45cf-4def-a06d-7943219cea8c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:10.125004 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a76dbeb-96ad-4faa-9c49-0b41d7959b67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-3a76dbeb-96ad-4faa-9c49-0b41d7959b67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:10.133328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:10.134286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:10.135070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:10.135070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:10.135070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:10.135070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:10.135070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:10.135070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:10.135070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:10.135070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:10.135070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:10.135070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:10.135070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:10.135070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:10.135070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 120/229] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:56:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 466 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:56:10.157194 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76dbeb-96ad-4faa-9c49-0b41d7959b67 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:10.180690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f98cb-d602-4550-be71-da21e4917195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:10.182302 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f98cb-d602-4550-be71-da21e4917195 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:10.182865 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f98cb-d602-4550-be71-da21e4917195 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:10.183341 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205f98cb-d602-4550-be71-da21e4917195 None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7/users/9a92f621defc404f9041f6636e268c5e/roles/5c1382efdc2e4eebaf5f15a4cdae58e0` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:10.187802 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f98cb-d602-4550-be71-da21e4917195 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d09612017fd488a94e457afdcdec8a7, user_id=9a92f621defc404f9041f6636e268c5e, role_id=5c1382efdc2e4eebaf5f15a4cdae58e0)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:10.190728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205f98cb-d602-4550-be71-da21e4917195 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:10.225680 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 110/230] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:56:09 2022] PUT /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7/users/9a92f621defc404f9041f6636e268c5e/roles/5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:56:10.371214 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a76dbeb-96ad-4faa-9c49-0b41d7959b67 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:10.416164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6aea6-2474-4acc-808f-7a946e4664e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:10.417259 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6aea6-2474-4acc-808f-7a946e4664e3 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:10.417745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6aea6-2474-4acc-808f-7a946e4664e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:10.418221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b6aea6-2474-4acc-808f-7a946e4664e3 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:10.419739 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6aea6-2474-4acc-808f-7a946e4664e3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:10.420274 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6aea6-2474-4acc-808f-7a946e4664e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:10.421877 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b6aea6-2474-4acc-808f-7a946e4664e3 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:10.431527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 121/231] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:56:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:10.440345 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f98cb-d602-4550-be71-da21e4917195 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:10.570015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:10.619935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205f98cb-d602-4550-be71-da21e4917195 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:10.686955 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eb706-bffd-4337-9dfc-20ef733684da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:10.688453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eb706-bffd-4337-9dfc-20ef733684da None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:10.688965 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eb706-bffd-4337-9dfc-20ef733684da None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:10.689465 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eb706-bffd-4337-9dfc-20ef733684da None admin] PATH_INFO: `/v3/users/9a92f621defc404f9041f6636e268c5e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:10.691475 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5eb706-bffd-4337-9dfc-20ef733684da None admin] RBAC: Authorizing `identity:get_user(user_id=9a92f621defc404f9041f6636e268c5e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:10.694299 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5eb706-bffd-4337-9dfc-20ef733684da None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:10.704426 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 111/232] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:10 2022] GET /identity/v3/users/9a92f621defc404f9041f6636e268c5e => generated 283 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:10.706771 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6aea6-2474-4acc-808f-7a946e4664e3 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:10.816511 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:10.927860 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b6aea6-2474-4acc-808f-7a946e4664e3 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:10.979769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e198a0a-5e92-4af0-8d1b-dc0dcaf85c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:10.980575 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e198a0a-5e92-4af0-8d1b-dc0dcaf85c7c None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:10.980854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e198a0a-5e92-4af0-8d1b-dc0dcaf85c7c None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:10.981136 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e198a0a-5e92-4af0-8d1b-dc0dcaf85c7c None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:10.982933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e198a0a-5e92-4af0-8d1b-dc0dcaf85c7c None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:10.984420 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e198a0a-5e92-4af0-8d1b-dc0dcaf85c7c None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:10.986449 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 122/233] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:10 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:10.995160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eb706-bffd-4337-9dfc-20ef733684da None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:11.212295 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eb706-bffd-4337-9dfc-20ef733684da None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:11.278424 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11abc131-389f-481f-8b37-14d8adba42e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:11.280973 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abc131-389f-481f-8b37-14d8adba42e8 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:11.281733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abc131-389f-481f-8b37-14d8adba42e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:11.282500 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11abc131-389f-481f-8b37-14d8adba42e8 None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7/users/9a92f621defc404f9041f6636e268c5e/roles/fb458495153d4239becfaff1b68b012e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:11.286954 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abc131-389f-481f-8b37-14d8adba42e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d09612017fd488a94e457afdcdec8a7, user_id=9a92f621defc404f9041f6636e268c5e, role_id=fb458495153d4239becfaff1b68b012e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:11.290090 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11abc131-389f-481f-8b37-14d8adba42e8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:11.309177 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:11.317993 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 112/234] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:56:10 2022] PUT /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7/users/9a92f621defc404f9041f6636e268c5e/roles/fb458495153d4239becfaff1b68b012e => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:56:12.093702 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555427b0-c4c0-4c49-8ac1-a334c5a7f402 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:12.094466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555427b0-c4c0-4c49-8ac1-a334c5a7f402 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:12.094852 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555427b0-c4c0-4c49-8ac1-a334c5a7f402 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:12.097469 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 123/235] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:12.105924 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b0248-fdfe-4522-a285-6b858b941ba9 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:12.107217 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b0248-fdfe-4522-a285-6b858b941ba9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:12.107384 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4b0248-fdfe-4522-a285-6b858b941ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:12.142779 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-7b4b0248-fdfe-4522-a285-6b858b941ba9 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:12.143947 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-7b4b0248-fdfe-4522-a285-6b858b941ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:12.274346 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 113/236] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:12.357776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555427b0-c4c0-4c49-8ac1-a334c5a7f402 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:12.618958 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555427b0-c4c0-4c49-8ac1-a334c5a7f402 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:12.659096 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:12.690487 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7115c3-dfae-4590-83d0-6d8060101a03 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:12.691407 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7115c3-dfae-4590-83d0-6d8060101a03 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:12.692189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7115c3-dfae-4590-83d0-6d8060101a03 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:12.695262 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 114/237] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:12.704273 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f769e-048b-44b0-b17e-2837b8c813b1 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:12.704761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f769e-048b-44b0-b17e-2837b8c813b1 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:12.705245 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f769e-048b-44b0-b17e-2837b8c813b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:12.719873 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0834d82-304e-485f-b1b6-ed882d7ad9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:12.725109 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0834d82-304e-485f-b1b6-ed882d7ad9e1 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:12.726773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0834d82-304e-485f-b1b6-ed882d7ad9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:12.727438 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0834d82-304e-485f-b1b6-ed882d7ad9e1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:12.739255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-135f769e-048b-44b0-b17e-2837b8c813b1 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:12.740587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-135f769e-048b-44b0-b17e-2837b8c813b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:12.765559 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0834d82-304e-485f-b1b6-ed882d7ad9e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-f0834d82-304e-485f-b1b6-ed882d7ad9e1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:12.784098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:12.785681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:12.787395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:12.787395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:12.787395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:12.787395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:12.787395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:12.787395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:12.787395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:12.787395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:12.787395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:12.787395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:12.787395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:12.787395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:12.787395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 124/238] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:12.798226 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0834d82-304e-485f-b1b6-ed882d7ad9e1 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:12.962338 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 115/239] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:13.074893 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f769e-048b-44b0-b17e-2837b8c813b1 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:13.112795 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0834d82-304e-485f-b1b6-ed882d7ad9e1 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:13.176959 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322d1ce-3083-4404-a999-f503eb8bc3c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:13.178206 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322d1ce-3083-4404-a999-f503eb8bc3c3 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:13.178701 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322d1ce-3083-4404-a999-f503eb8bc3c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:13.179207 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322d1ce-3083-4404-a999-f503eb8bc3c3 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:13.180849 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322d1ce-3083-4404-a999-f503eb8bc3c3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:13.181406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322d1ce-3083-4404-a999-f503eb8bc3c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:13.184254 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322d1ce-3083-4404-a999-f503eb8bc3c3 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:13.201110 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:13.201861 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 125/240] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:13.203215 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed99f7-43c5-49c1-854b-1bcaa957b5ce None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:13.203803 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed99f7-43c5-49c1-854b-1bcaa957b5ce None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:13.204089 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed99f7-43c5-49c1-854b-1bcaa957b5ce None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:13.208029 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 126/241] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:13.214908 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed99f7-43c5-49c1-854b-1bcaa957b5ce None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:13.262373 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f769e-048b-44b0-b17e-2837b8c813b1 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:13.292374 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:13.308479 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dea698-f433-46b9-aefd-a8f08838b883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:13.309296 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dea698-f433-46b9-aefd-a8f08838b883 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:13.309617 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dea698-f433-46b9-aefd-a8f08838b883 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:13.309902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dea698-f433-46b9-aefd-a8f08838b883 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:13.311755 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dea698-f433-46b9-aefd-a8f08838b883 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:13.313607 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24dea698-f433-46b9-aefd-a8f08838b883 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:13.315692 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 116/242] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:56:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:13.317268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfb5cd-98b1-497a-9986-213e4ef3598c None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:13.317595 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfb5cd-98b1-497a-9986-213e4ef3598c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:13.317841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dfb5cd-98b1-497a-9986-213e4ef3598c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:13.338259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-78dfb5cd-98b1-497a-9986-213e4ef3598c None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:13.339823 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-78dfb5cd-98b1-497a-9986-213e4ef3598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:13.396882 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed99f7-43c5-49c1-854b-1bcaa957b5ce None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:13.454702 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8e529-dd4f-476f-b437-966122f5f5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:13.457254 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8e529-dd4f-476f-b437-966122f5f5ce None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:13.458072 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8e529-dd4f-476f-b437-966122f5f5ce None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:13.458309 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 117/243] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:13.459045 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a8e529-dd4f-476f-b437-966122f5f5ce None admin] PATH_INFO: `/v3/users/9acb8b082197447b89bd27b453b6b330` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:13.459199 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfb5cd-98b1-497a-9986-213e4ef3598c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:13.489939 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8e529-dd4f-476f-b437-966122f5f5ce None admin] RBAC: Authorizing `identity:get_user(user_id=9acb8b082197447b89bd27b453b6b330)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:13.493625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22a8e529-dd4f-476f-b437-966122f5f5ce None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:13.497532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 127/244] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:13 2022] GET /identity/v3/users/9acb8b082197447b89bd27b453b6b330 => generated 297 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:13.506814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8e529-dd4f-476f-b437-966122f5f5ce None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:13.604113 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:13.709224 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dfb5cd-98b1-497a-9986-213e4ef3598c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:13.718664 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:13.733539 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a8e529-dd4f-476f-b437-966122f5f5ce None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:13.790747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d500873-9a0b-45dc-9a94-6eeb8be08da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:13.792029 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d500873-9a0b-45dc-9a94-6eeb8be08da8 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:13.792599 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d500873-9a0b-45dc-9a94-6eeb8be08da8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:13.793123 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d500873-9a0b-45dc-9a94-6eeb8be08da8 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:13.794547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d500873-9a0b-45dc-9a94-6eeb8be08da8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:13.796305 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75514d5-517c-4398-8783-b4b007dd4649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:13.796974 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75514d5-517c-4398-8783-b4b007dd4649 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:13.797258 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75514d5-517c-4398-8783-b4b007dd4649 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:13.797536 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75514d5-517c-4398-8783-b4b007dd4649 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:13.797681 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d500873-9a0b-45dc-9a94-6eeb8be08da8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:13.828440 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 118/245] 10.222.0.25 () {60 vars in 1132 bytes} [Wed May 25 07:56:13 2022] POST /identity/v3/users => generated 293 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:56:13.829291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d500873-9a0b-45dc-9a94-6eeb8be08da8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:13.979612 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75514d5-517c-4398-8783-b4b007dd4649 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:13.980692 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d500873-9a0b-45dc-9a94-6eeb8be08da8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:13.981093 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75514d5-517c-4398-8783-b4b007dd4649 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:14.016670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:14.044234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2aa427-01e8-46ec-b7b7-aa98c82ce06b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:14.045071 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aa427-01e8-46ec-b7b7-aa98c82ce06b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:14.045367 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aa427-01e8-46ec-b7b7-aa98c82ce06b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:14.045635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2aa427-01e8-46ec-b7b7-aa98c82ce06b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:14.059454 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2aa427-01e8-46ec-b7b7-aa98c82ce06b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-ee2aa427-01e8-46ec-b7b7-aa98c82ce06b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:14.068357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:14.070133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 119/246] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:14.071749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0f0c0-be6b-4184-a74e-b934f10db57d None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:14.073304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0f0c0-be6b-4184-a74e-b934f10db57d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:14.073304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a0f0c0-be6b-4184-a74e-b934f10db57d None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:14.073304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 120/247] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:14.079034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0f0c0-be6b-4184-a74e-b934f10db57d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:14.165515 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:14.181969 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 128/248] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 676 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:14.185434 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35742499-d78f-471b-bfa7-40496e812f80 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:14.186416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35742499-d78f-471b-bfa7-40496e812f80 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:14.187311 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35742499-d78f-471b-bfa7-40496e812f80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:14.217107 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-35742499-d78f-471b-bfa7-40496e812f80 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:14.219703 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-35742499-d78f-471b-bfa7-40496e812f80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:14.257055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a0f0c0-be6b-4184-a74e-b934f10db57d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:14.323434 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11296150-8f43-444e-8290-354e5a83dc67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:14.324685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296150-8f43-444e-8290-354e5a83dc67 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:14.325281 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296150-8f43-444e-8290-354e5a83dc67 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:14.325799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11296150-8f43-444e-8290-354e5a83dc67 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:14.328047 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11296150-8f43-444e-8290-354e5a83dc67 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:14.328047 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11296150-8f43-444e-8290-354e5a83dc67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:14.330641 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11296150-8f43-444e-8290-354e5a83dc67 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:14.345315 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 129/249] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:14.346196 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35742499-d78f-471b-bfa7-40496e812f80 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:14.348820 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 121/250] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:14.365307 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11296150-8f43-444e-8290-354e5a83dc67 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:14.444835 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:14.559030 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35742499-d78f-471b-bfa7-40496e812f80 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:14.582276 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11296150-8f43-444e-8290-354e5a83dc67 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:14.620457 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:14.638648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fb429-2a04-4ff4-a123-af3691a8abf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:14.640199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fb429-2a04-4ff4-a123-af3691a8abf7 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:14.640691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fb429-2a04-4ff4-a123-af3691a8abf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:14.641165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fb429-2a04-4ff4-a123-af3691a8abf7 None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:14.644052 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fb429-2a04-4ff4-a123-af3691a8abf7 None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:14.648074 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fb429-2a04-4ff4-a123-af3691a8abf7 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:14.652511 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 130/251] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:14 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:14.654844 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fb429-2a04-4ff4-a123-af3691a8abf7 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:14.660377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaa5d8-78cc-40f7-9fda-86dc67cbb5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:14.662129 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaa5d8-78cc-40f7-9fda-86dc67cbb5d3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:14.662689 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaa5d8-78cc-40f7-9fda-86dc67cbb5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:14.663563 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65aaa5d8-78cc-40f7-9fda-86dc67cbb5d3 None admin] PATH_INFO: `/v3/users/5f0136e0d64b4a3c96c5f268e35af43c` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:14.665949 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aaa5d8-78cc-40f7-9fda-86dc67cbb5d3 None admin] RBAC: Authorizing `identity:get_user(user_id=5f0136e0d64b4a3c96c5f268e35af43c)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:14.668712 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65aaa5d8-78cc-40f7-9fda-86dc67cbb5d3 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:14.673131 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 122/252] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:14 2022] GET /identity/v3/users/5f0136e0d64b4a3c96c5f268e35af43c => generated 297 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:14.674729 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaa5d8-78cc-40f7-9fda-86dc67cbb5d3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:14.885315 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fb429-2a04-4ff4-a123-af3691a8abf7 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:14.959777 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05c7eb-c73f-4f3f-849b-3eee38647b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:14.961915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05c7eb-c73f-4f3f-849b-3eee38647b78 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:14.962438 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05c7eb-c73f-4f3f-849b-3eee38647b78 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:14.962966 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05c7eb-c73f-4f3f-849b-3eee38647b78 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:14.988566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec05c7eb-c73f-4f3f-849b-3eee38647b78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-ec05c7eb-c73f-4f3f-849b-3eee38647b78 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:15.006799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:15.010569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 131/253] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:56:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:15.014165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05c7eb-c73f-4f3f-849b-3eee38647b78 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:15.022765 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65aaa5d8-78cc-40f7-9fda-86dc67cbb5d3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:15.034439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:15.172690 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:15.176871 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d21ef-c914-4e81-871c-2d4d5a796ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:15.177544 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d21ef-c914-4e81-871c-2d4d5a796ae5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:15.177827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d21ef-c914-4e81-871c-2d4d5a796ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:15.178110 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044d21ef-c914-4e81-871c-2d4d5a796ae5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:15.179149 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d21ef-c914-4e81-871c-2d4d5a796ae5 None admin] RBAC: Adding query filter params (role.id=040d082ba25f428a898a87057e2f7341, scope.project.id=6d09612017fd488a94e457afdcdec8a7, user.id=9acb8b082197447b89bd27b453b6b330) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:15.179468 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d21ef-c914-4e81-871c-2d4d5a796ae5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:15.181002 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044d21ef-c914-4e81-871c-2d4d5a796ae5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:15.206388 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 123/254] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:56:14 2022] GET /identity/v3/role_assignments?user.id=9acb8b082197447b89bd27b453b6b330&scope.project.id=6d09612017fd488a94e457afdcdec8a7&role.id=040d082ba25f428a898a87057e2f7341 => generated 259 bytes in 532 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:15.206991 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d21ef-c914-4e81-871c-2d4d5a796ae5 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:15.266650 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec05c7eb-c73f-4f3f-849b-3eee38647b78 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:15.377583 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be834146-57a7-4669-8d9f-d7a7edc3fb4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:15.380111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be834146-57a7-4669-8d9f-d7a7edc3fb4d None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:15.380668 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be834146-57a7-4669-8d9f-d7a7edc3fb4d None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:15.381190 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be834146-57a7-4669-8d9f-d7a7edc3fb4d None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:15.386120 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be834146-57a7-4669-8d9f-d7a7edc3fb4d None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:15.389547 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be834146-57a7-4669-8d9f-d7a7edc3fb4d None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:15.393895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 132/255] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:15 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:15.403013 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be834146-57a7-4669-8d9f-d7a7edc3fb4d None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:15.626480 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044d21ef-c914-4e81-871c-2d4d5a796ae5 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:15.709286 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b724f5-e3eb-4239-8791-d76820d0e78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:15.709964 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b724f5-e3eb-4239-8791-d76820d0e78a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:15.710254 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b724f5-e3eb-4239-8791-d76820d0e78a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:15.710539 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b724f5-e3eb-4239-8791-d76820d0e78a None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:15.711648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b724f5-e3eb-4239-8791-d76820d0e78a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:15.711987 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b724f5-e3eb-4239-8791-d76820d0e78a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:15.713741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b724f5-e3eb-4239-8791-d76820d0e78a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:15.718332 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be834146-57a7-4669-8d9f-d7a7edc3fb4d None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:15.725740 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 124/256] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 519 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:15.732169 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1582cd-86bf-4491-ad22-7bed12f50c21 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:15.732169 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1582cd-86bf-4491-ad22-7bed12f50c21 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:15.732169 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1582cd-86bf-4491-ad22-7bed12f50c21 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:15.732169 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 125/257] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:15.735917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2ab65-541f-4bd1-86da-17905d8366b9 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:15.736244 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2ab65-541f-4bd1-86da-17905d8366b9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:15.736518 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f2ab65-541f-4bd1-86da-17905d8366b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:15.762993 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-d6f2ab65-541f-4bd1-86da-17905d8366b9 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:15.762993 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-d6f2ab65-541f-4bd1-86da-17905d8366b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:15.795654 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:15.818079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:15.827040 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fd3e0-4253-4483-b26d-24c42548b382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:15.830524 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd3e0-4253-4483-b26d-24c42548b382 None admin] REQUEST_METHOD: `PUT` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:15.831054 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd3e0-4253-4483-b26d-24c42548b382 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:15.831570 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9fd3e0-4253-4483-b26d-24c42548b382 None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7/users/5f0136e0d64b4a3c96c5f268e35af43c/roles/0e5f3c37f30e45da98262a20b891833d` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:15.839891 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fd3e0-4253-4483-b26d-24c42548b382 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d09612017fd488a94e457afdcdec8a7, user_id=5f0136e0d64b4a3c96c5f268e35af43c, role_id=0e5f3c37f30e45da98262a20b891833d)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:15.842941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9fd3e0-4253-4483-b26d-24c42548b382 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:15.897241 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 133/258] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:56:15 2022] PUT /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7/users/5f0136e0d64b4a3c96c5f268e35af43c/roles/0e5f3c37f30e45da98262a20b891833d => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:56:15.900235 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fd3e0-4253-4483-b26d-24c42548b382 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:15.993975 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 126/259] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:56:16.037395 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2ab65-541f-4bd1-86da-17905d8366b9 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:16.265377 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9fd3e0-4253-4483-b26d-24c42548b382 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:16.332358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b7e19-9fc0-4d3e-b0b1-69acf1d0d61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:16.333688 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7e19-9fc0-4d3e-b0b1-69acf1d0d61c None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:16.334183 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7e19-9fc0-4d3e-b0b1-69acf1d0d61c None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:16.334677 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231b7e19-9fc0-4d3e-b0b1-69acf1d0d61c None admin] PATH_INFO: `/v3/users/9a92f621defc404f9041f6636e268c5e` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:16.338671 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b7e19-9fc0-4d3e-b0b1-69acf1d0d61c None admin] RBAC: Authorizing `identity:get_user(user_id=9a92f621defc404f9041f6636e268c5e)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:16.342404 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231b7e19-9fc0-4d3e-b0b1-69acf1d0d61c None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:16.346044 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 134/260] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:15 2022] GET /identity/v3/users/9a92f621defc404f9041f6636e268c5e => generated 283 bytes in 449 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:16.352493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b7e19-9fc0-4d3e-b0b1-69acf1d0d61c None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:16.372537 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f2ab65-541f-4bd1-86da-17905d8366b9 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:16.441676 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073cbb-9e9d-4a0a-ac77-580e5c6f7cb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:16.443429 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073cbb-9e9d-4a0a-ac77-580e5c6f7cb0 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:16.444171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073cbb-9e9d-4a0a-ac77-580e5c6f7cb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:16.444962 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f073cbb-9e9d-4a0a-ac77-580e5c6f7cb0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:16.466444 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f073cbb-9e9d-4a0a-ac77-580e5c6f7cb0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-3f073cbb-9e9d-4a0a-ac77-580e5c6f7cb0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:16.484691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:16.486466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:16.488031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:16.488031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:16.488031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:16.488031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:16.488031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:16.488031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:16.488031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:16.488031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:16.488031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:16.488031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:16.488031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:16.488031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:16.493080 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 127/261] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:56:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 457 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:16.502111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073cbb-9e9d-4a0a-ac77-580e5c6f7cb0 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:16.504522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:16.575550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:16.640445 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231b7e19-9fc0-4d3e-b0b1-69acf1d0d61c None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:16.755826 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb2896-fa92-4e0a-a719-596ed252b1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:16.756961 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb2896-fa92-4e0a-a719-596ed252b1f4 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:16.757469 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb2896-fa92-4e0a-a719-596ed252b1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:16.757962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdb2896-fa92-4e0a-a719-596ed252b1f4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:16.885054 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f073cbb-9e9d-4a0a-ac77-580e5c6f7cb0 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:16.987894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff04a2-2d70-4cd7-acda-297693838a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:16.988621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff04a2-2d70-4cd7-acda-297693838a73 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:16.988908 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff04a2-2d70-4cd7-acda-297693838a73 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:16.989207 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff04a2-2d70-4cd7-acda-297693838a73 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:16.989952 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff04a2-2d70-4cd7-acda-297693838a73 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:16.990260 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff04a2-2d70-4cd7-acda-297693838a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:16.991682 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff04a2-2d70-4cd7-acda-297693838a73 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:17.014564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 128/262] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:56:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 514 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:17.022644 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff04a2-2d70-4cd7-acda-297693838a73 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:17.031249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb2896-fa92-4e0a-a719-596ed252b1f4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:17.032896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdb2896-fa92-4e0a-a719-596ed252b1f4 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:17.192694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:17.261008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:17.313550 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 135/263] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 962 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:17.321263 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb2896-fa92-4e0a-a719-596ed252b1f4 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:17.323332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff04a2-2d70-4cd7-acda-297693838a73 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:17.420914 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35664ac1-5e59-4eac-9021-066b78bde65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:17.422076 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35664ac1-5e59-4eac-9021-066b78bde65a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:17.422541 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35664ac1-5e59-4eac-9021-066b78bde65a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:17.422967 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35664ac1-5e59-4eac-9021-066b78bde65a None admin] PATH_INFO: `/v3/users/9a92f621defc404f9041f6636e268c5e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:17.424517 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35664ac1-5e59-4eac-9021-066b78bde65a None admin] RBAC: Authorizing `identity:get_user(user_id=9a92f621defc404f9041f6636e268c5e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:17.426163 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35664ac1-5e59-4eac-9021-066b78bde65a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:17.428411 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 129/264] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:17 2022] GET /identity/v3/users/9a92f621defc404f9041f6636e268c5e => generated 283 bytes in 407 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:17.434009 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35664ac1-5e59-4eac-9021-066b78bde65a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:17.655468 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdb2896-fa92-4e0a-a719-596ed252b1f4 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:17.709455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35664ac1-5e59-4eac-9021-066b78bde65a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:17.761508 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b77fe74-150c-459a-97b8-570371fa71bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:17.764768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77fe74-150c-459a-97b8-570371fa71bb None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:17.765634 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77fe74-150c-459a-97b8-570371fa71bb None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:17.767206 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b77fe74-150c-459a-97b8-570371fa71bb None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:17.769159 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77fe74-150c-459a-97b8-570371fa71bb None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:17.771727 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b77fe74-150c-459a-97b8-570371fa71bb None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:17.774032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 136/265] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:17 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 453 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:17.777181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523927b-b79d-4e97-b946-d6ec62635944 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:17.778763 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523927b-b79d-4e97-b946-d6ec62635944 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:17.779952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9523927b-b79d-4e97-b946-d6ec62635944 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:17.784013 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 137/266] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:17.790822 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523927b-b79d-4e97-b946-d6ec62635944 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:17.791711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc34480-f48c-4a84-befd-35734c76c790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:17.792676 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34480-f48c-4a84-befd-35734c76c790 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:17.793206 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34480-f48c-4a84-befd-35734c76c790 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:17.793723 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc34480-f48c-4a84-befd-35734c76c790 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:17.825741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:17.855868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:17.927283 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc34480-f48c-4a84-befd-35734c76c790 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:17.930169 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc34480-f48c-4a84-befd-35734c76c790 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:18.035754 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9523927b-b79d-4e97-b946-d6ec62635944 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:18.106312 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfb27aa-a4c0-4cf3-8624-cf9a107de2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:18.107948 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb27aa-a4c0-4cf3-8624-cf9a107de2bf None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:18.109034 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb27aa-a4c0-4cf3-8624-cf9a107de2bf None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:18.109766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfb27aa-a4c0-4cf3-8624-cf9a107de2bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:18.111999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb27aa-a4c0-4cf3-8624-cf9a107de2bf None admin] RBAC: Adding query filter params (role.id=5c1382efdc2e4eebaf5f15a4cdae58e0, scope.project.id=6d09612017fd488a94e457afdcdec8a7, user.id=9a92f621defc404f9041f6636e268c5e) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:18.112845 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb27aa-a4c0-4cf3-8624-cf9a107de2bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:18.115816 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 130/267] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 682 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 07:56:18.116179 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfb27aa-a4c0-4cf3-8624-cf9a107de2bf None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:18.117482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cc23d-29ea-4f7b-8af1-148cb4256363 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:18.117882 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cc23d-29ea-4f7b-8af1-148cb4256363 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:18.118268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8cc23d-29ea-4f7b-8af1-148cb4256363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:18.130919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 138/268] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:56:17 2022] GET /identity/v3/role_assignments?user.id=9a92f621defc404f9041f6636e268c5e&scope.project.id=6d09612017fd488a94e457afdcdec8a7&role.id=5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:18.134004 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b00c1b-86e1-4877-85ee-dabaefe716c6 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:18.134877 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b00c1b-86e1-4877-85ee-dabaefe716c6 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:18.135599 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b00c1b-86e1-4877-85ee-dabaefe716c6 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:18.136993 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-5b8cc23d-29ea-4f7b-8af1-148cb4256363 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:18.139104 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-5b8cc23d-29ea-4f7b-8af1-148cb4256363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:18.146881 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 139/269] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:18.149093 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b00c1b-86e1-4877-85ee-dabaefe716c6 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:18.225918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:18.273768 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 131/270] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:18.275277 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495a21b-edc5-41a1-8526-a3081f295bae None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:18.275594 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495a21b-edc5-41a1-8526-a3081f295bae None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:18.275827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1495a21b-edc5-41a1-8526-a3081f295bae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:18.313387 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-1495a21b-edc5-41a1-8526-a3081f295bae None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:18.314629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-1495a21b-edc5-41a1-8526-a3081f295bae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:18.356581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:18.375133 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b00c1b-86e1-4877-85ee-dabaefe716c6 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:18.455838 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 132/271] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:18.455838 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495a21b-edc5-41a1-8526-a3081f295bae None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:18.466446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c9f51-50f2-4fe6-bf17-780de51d0893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:18.468583 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c9f51-50f2-4fe6-bf17-780de51d0893 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:18.469433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c9f51-50f2-4fe6-bf17-780de51d0893 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:18.470380 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c9f51-50f2-4fe6-bf17-780de51d0893 None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:18.475218 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c9f51-50f2-4fe6-bf17-780de51d0893 None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:18.478207 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c9f51-50f2-4fe6-bf17-780de51d0893 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:18.488252 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 140/272] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:18 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:18.490324 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c9f51-50f2-4fe6-bf17-780de51d0893 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:18.616028 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1495a21b-edc5-41a1-8526-a3081f295bae None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:18.637280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:18.686761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350acbf4-de13-4d79-b1e2-a775f076fad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:18.687769 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350acbf4-de13-4d79-b1e2-a775f076fad4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:18.688243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350acbf4-de13-4d79-b1e2-a775f076fad4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:18.688715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350acbf4-de13-4d79-b1e2-a775f076fad4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:18.708666 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350acbf4-de13-4d79-b1e2-a775f076fad4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-350acbf4-de13-4d79-b1e2-a775f076fad4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:18.722981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:18.724841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:18.726461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:18.726461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:18.726461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:18.726461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:18.726461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:18.726461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:18.726461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:18.726461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:18.726461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:18.726461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:18.726461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:18.726461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:18.726461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 133/273] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:18.729772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350acbf4-de13-4d79-b1e2-a775f076fad4 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:18.749999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c9f51-50f2-4fe6-bf17-780de51d0893 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:18.812208 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a783ff-cc3a-428b-bba0-c351b4d3e0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:18.813789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a783ff-cc3a-428b-bba0-c351b4d3e0ed None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:18.814691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a783ff-cc3a-428b-bba0-c351b4d3e0ed None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:18.815512 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a783ff-cc3a-428b-bba0-c351b4d3e0ed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:18.817512 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a783ff-cc3a-428b-bba0-c351b4d3e0ed None admin] RBAC: Adding query filter params (role.id=fb458495153d4239becfaff1b68b012e, scope.project.id=6d09612017fd488a94e457afdcdec8a7, user.id=9a92f621defc404f9041f6636e268c5e) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:18.818361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a783ff-cc3a-428b-bba0-c351b4d3e0ed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:18.822091 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a783ff-cc3a-428b-bba0-c351b4d3e0ed None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:18.834419 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 141/274] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:56:18 2022] GET /identity/v3/role_assignments?user.id=9a92f621defc404f9041f6636e268c5e&scope.project.id=6d09612017fd488a94e457afdcdec8a7&role.id=fb458495153d4239becfaff1b68b012e => generated 608 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:18.836288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a783ff-cc3a-428b-bba0-c351b4d3e0ed None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:18.891057 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:19.006397 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350acbf4-de13-4d79-b1e2-a775f076fad4 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:19.109019 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa0279-cfd8-4a55-8eb2-9d2d79319d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:19.109856 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa0279-cfd8-4a55-8eb2-9d2d79319d7a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:19.110133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa0279-cfd8-4a55-8eb2-9d2d79319d7a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:19.110418 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aa0279-cfd8-4a55-8eb2-9d2d79319d7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:19.111790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa0279-cfd8-4a55-8eb2-9d2d79319d7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:19.113579 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aa0279-cfd8-4a55-8eb2-9d2d79319d7a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:19.115358 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 134/275] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:56:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:19.125657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa0279-cfd8-4a55-8eb2-9d2d79319d7a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:19.127070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a783ff-cc3a-428b-bba0-c351b4d3e0ed None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:19.197474 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:19.221915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8efa3-e844-4c42-9173-b50743eea5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:19.223095 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8efa3-e844-4c42-9173-b50743eea5eb None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:19.223571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8efa3-e844-4c42-9173-b50743eea5eb None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:19.224045 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab8efa3-e844-4c42-9173-b50743eea5eb None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:19.225415 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8efa3-e844-4c42-9173-b50743eea5eb None admin] RBAC: Adding query filter params (name=member) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:19.225943 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8efa3-e844-4c42-9173-b50743eea5eb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:19.230043 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab8efa3-e844-4c42-9173-b50743eea5eb None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:19.254703 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 142/276] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 419 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:19.262059 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8efa3-e844-4c42-9173-b50743eea5eb None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:19.286792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aa0279-cfd8-4a55-8eb2-9d2d79319d7a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:19.332603 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d55a82-3f28-45db-9f2b-b7ab51308101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:19.333322 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55a82-3f28-45db-9f2b-b7ab51308101 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:19.333607 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55a82-3f28-45db-9f2b-b7ab51308101 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:19.333881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d55a82-3f28-45db-9f2b-b7ab51308101 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:19.334643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55a82-3f28-45db-9f2b-b7ab51308101 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:19.337479 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d55a82-3f28-45db-9f2b-b7ab51308101 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:19.368678 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 135/277] 10.222.0.25 () {60 vars in 1132 bytes} [Wed May 25 07:56:19 2022] POST /identity/v3/users => generated 293 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:56:19.371013 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c37b9-56d5-4845-bd0b-378f82e84fb2 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:19.371344 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c37b9-56d5-4845-bd0b-378f82e84fb2 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:19.375751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c37b9-56d5-4845-bd0b-378f82e84fb2 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:19.375751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 136/278] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:19.385804 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6d6b-f91c-43ea-8d32-5afb86267a1d None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:19.386254 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6d6b-f91c-43ea-8d32-5afb86267a1d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:19.386519 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab6d6b-f91c-43ea-8d32-5afb86267a1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:19.401881 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:19.410633 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-a9ab6d6b-f91c-43ea-8d32-5afb86267a1d None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:19.412903 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a9ab6d6b-f91c-43ea-8d32-5afb86267a1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:19.433476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab8efa3-e844-4c42-9173-b50743eea5eb None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:19.486660 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a147f04-095e-4eca-b0b1-d1c00e6e279b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:19.487573 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a147f04-095e-4eca-b0b1-d1c00e6e279b None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:19.487835 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a147f04-095e-4eca-b0b1-d1c00e6e279b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:19.488157 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a147f04-095e-4eca-b0b1-d1c00e6e279b None admin] PATH_INFO: `/v3/users/2a21b7b8ca5e4418822d2a5fbeb35d4c` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:19.507157 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a147f04-095e-4eca-b0b1-d1c00e6e279b None admin] RBAC: Authorizing `identity:get_user(user_id=2a21b7b8ca5e4418822d2a5fbeb35d4c)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:19.508878 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a147f04-095e-4eca-b0b1-d1c00e6e279b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:19.511203 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 143/279] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:19 2022] GET /identity/v3/users/2a21b7b8ca5e4418822d2a5fbeb35d4c => generated 293 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:19.519484 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a147f04-095e-4eca-b0b1-d1c00e6e279b None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:19.531885 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 137/280] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:19.559985 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab6d6b-f91c-43ea-8d32-5afb86267a1d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:19.589777 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:19.689345 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a147f04-095e-4eca-b0b1-d1c00e6e279b None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:19.705732 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab6d6b-f91c-43ea-8d32-5afb86267a1d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:19.748732 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-debb140b-a35c-4c13-a9fd-4824549af8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:19.749788 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb140b-a35c-4c13-a9fd-4824549af8bc None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:19.750241 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb140b-a35c-4c13-a9fd-4824549af8bc None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:19.750792 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-debb140b-a35c-4c13-a9fd-4824549af8bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:19.753778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb140b-a35c-4c13-a9fd-4824549af8bc None admin] RBAC: Adding query filter params (role.id=0e5f3c37f30e45da98262a20b891833d, user.id=2a21b7b8ca5e4418822d2a5fbeb35d4c, scope.system=all) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:19.754421 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb140b-a35c-4c13-a9fd-4824549af8bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:19.757251 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-debb140b-a35c-4c13-a9fd-4824549af8bc None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:19.760730 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5746a81-030a-44be-a875-d096b168ef31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:19.761069 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:19.764804 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5746a81-030a-44be-a875-d096b168ef31 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:19.764804 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5746a81-030a-44be-a875-d096b168ef31 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:19.764804 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5746a81-030a-44be-a875-d096b168ef31 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:19.776456 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 144/281] 10.222.0.25 () {56 vars in 1308 bytes} [Wed May 25 07:56:19 2022] GET /identity/v3/role_assignments?user.id=2a21b7b8ca5e4418822d2a5fbeb35d4c&scope.system=all&role.id=0e5f3c37f30e45da98262a20b891833d => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:19.777970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a8725-fe2a-4556-9a34-e0a489d2039b None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:19.778791 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a8725-fe2a-4556-9a34-e0a489d2039b None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:19.779086 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a8725-fe2a-4556-9a34-e0a489d2039b None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:19.781262 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 145/282] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:19.790258 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5746a81-030a-44be-a875-d096b168ef31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:19.791679 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee981c1-f3a3-4da9-bee6-cf1bb64b6687 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:19.792071 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee981c1-f3a3-4da9-bee6-cf1bb64b6687 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:19.792352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee981c1-f3a3-4da9-bee6-cf1bb64b6687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-b5746a81-030a-44be-a875-d096b168ef31 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:19.805690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:19.807287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:19.808824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:19.808824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:19.808824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:19.808824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:19.808824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:19.808824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:19.808824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:19.808824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:19.808824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:19.808824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:19.808824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:19.808824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:19.808824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 138/283] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:56:19.814570 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5746a81-030a-44be-a875-d096b168ef31 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:19.821780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-3ee981c1-f3a3-4da9-bee6-cf1bb64b6687 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:19.824577 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-3ee981c1-f3a3-4da9-bee6-cf1bb64b6687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:19.932575 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:19.954167 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5746a81-030a-44be-a875-d096b168ef31 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:19.975236 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 146/284] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:19.995282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75d86f-8b33-48ed-8123-8e51c0690d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:19.995987 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75d86f-8b33-48ed-8123-8e51c0690d3e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:19.996315 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75d86f-8b33-48ed-8123-8e51c0690d3e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:19.996596 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe75d86f-8b33-48ed-8123-8e51c0690d3e None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:19.997437 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75d86f-8b33-48ed-8123-8e51c0690d3e None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:19.997749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75d86f-8b33-48ed-8123-8e51c0690d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:19.999226 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe75d86f-8b33-48ed-8123-8e51c0690d3e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:20.009111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 139/285] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:20.012401 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee981c1-f3a3-4da9-bee6-cf1bb64b6687 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:20.014907 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75d86f-8b33-48ed-8123-8e51c0690d3e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:20.185960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe75d86f-8b33-48ed-8123-8e51c0690d3e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:20.257536 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390787ec-703f-403c-b2af-5580c13a5901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:20.259032 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390787ec-703f-403c-b2af-5580c13a5901 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:20.259532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390787ec-703f-403c-b2af-5580c13a5901 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:20.260019 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390787ec-703f-403c-b2af-5580c13a5901 None admin] PATH_INFO: `/v3/users/5f0136e0d64b4a3c96c5f268e35af43c` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:20.263502 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390787ec-703f-403c-b2af-5580c13a5901 None admin] RBAC: Authorizing `identity:get_user(user_id=5f0136e0d64b4a3c96c5f268e35af43c)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:20.267311 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390787ec-703f-403c-b2af-5580c13a5901 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:20.271817 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 140/286] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:20 2022] GET /identity/v3/users/5f0136e0d64b4a3c96c5f268e35af43c => generated 297 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:20.277807 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390787ec-703f-403c-b2af-5580c13a5901 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:20.292885 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee981c1-f3a3-4da9-bee6-cf1bb64b6687 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:20.341308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:20.356322 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:20.373962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9eb69d-ee0a-41ee-9036-31e37bea4d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:20.374789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9eb69d-ee0a-41ee-9036-31e37bea4d29 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:20.375077 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9eb69d-ee0a-41ee-9036-31e37bea4d29 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:20.375356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9eb69d-ee0a-41ee-9036-31e37bea4d29 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:20.392955 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9eb69d-ee0a-41ee-9036-31e37bea4d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-0a9eb69d-ee0a-41ee-9036-31e37bea4d29 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:20.401376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:20.402769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:20.405530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:20.405530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:20.405530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:20.405530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:20.405530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:20.405530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:20.405530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:20.405530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:20.405530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:20.405530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:20.405530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:20.405530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:20.405530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 147/287] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:20 2022] GET /identity/v3/roles/reader => generated 84 bytes in 392 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:20.412183 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9eb69d-ee0a-41ee-9036-31e37bea4d29 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:20.544849 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9eb69d-ee0a-41ee-9036-31e37bea4d29 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:20.562742 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390787ec-703f-403c-b2af-5580c13a5901 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:20.623317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17c629-c5cc-468d-97b5-78a0cd652465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:20.624514 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c629-c5cc-468d-97b5-78a0cd652465 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:20.625021 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c629-c5cc-468d-97b5-78a0cd652465 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:20.625520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f17c629-c5cc-468d-97b5-78a0cd652465 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:20.626937 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17c629-c5cc-468d-97b5-78a0cd652465 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:20.627496 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17c629-c5cc-468d-97b5-78a0cd652465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:20.635575 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f17c629-c5cc-468d-97b5-78a0cd652465 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:20.658037 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479cbb5-0ad0-49a1-ba8b-e8cd824b2645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:20.659162 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479cbb5-0ad0-49a1-ba8b-e8cd824b2645 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:20.659668 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479cbb5-0ad0-49a1-ba8b-e8cd824b2645 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:20.660196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0479cbb5-0ad0-49a1-ba8b-e8cd824b2645 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:20.671547 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 148/288] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:20.680650 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17c629-c5cc-468d-97b5-78a0cd652465 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:20.844604 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:20.905943 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479cbb5-0ad0-49a1-ba8b-e8cd824b2645 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:20.911281 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0479cbb5-0ad0-49a1-ba8b-e8cd824b2645 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:20.957429 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:21.007512 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f17c629-c5cc-468d-97b5-78a0cd652465 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:21.139473 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859aea1f-19f7-4ed0-bcf4-7748b42e1414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:21.141029 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859aea1f-19f7-4ed0-bcf4-7748b42e1414 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:21.141788 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859aea1f-19f7-4ed0-bcf4-7748b42e1414 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:21.142266 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859aea1f-19f7-4ed0-bcf4-7748b42e1414 None admin] PATH_INFO: `/v3/users/9acb8b082197447b89bd27b453b6b330` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:21.157342 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859aea1f-19f7-4ed0-bcf4-7748b42e1414 None admin] RBAC: Authorizing `identity:get_user(user_id=9acb8b082197447b89bd27b453b6b330)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:21.160980 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859aea1f-19f7-4ed0-bcf4-7748b42e1414 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:21.165198 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 149/289] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:20 2022] GET /identity/v3/users/9acb8b082197447b89bd27b453b6b330 => generated 297 bytes in 485 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:21.173826 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859aea1f-19f7-4ed0-bcf4-7748b42e1414 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:21.196278 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 141/290] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 915 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:21.198263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479cbb5-0ad0-49a1-ba8b-e8cd824b2645 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:21.314693 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0479cbb5-0ad0-49a1-ba8b-e8cd824b2645 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:21.332523 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:21.364691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6b21c-b207-420c-9f12-9dba1d84dbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:21.368614 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6b21c-b207-420c-9f12-9dba1d84dbb0 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:21.368919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6b21c-b207-420c-9f12-9dba1d84dbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:21.369168 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d6b21c-b207-420c-9f12-9dba1d84dbb0 None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:21.371627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6b21c-b207-420c-9f12-9dba1d84dbb0 None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:21.376307 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d6b21c-b207-420c-9f12-9dba1d84dbb0 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:21.376307 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 142/291] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:21 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:21.381290 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6b21c-b207-420c-9f12-9dba1d84dbb0 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:21.490691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859aea1f-19f7-4ed0-bcf4-7748b42e1414 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:21.539872 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:21.608967 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dd5b3-43dd-4e07-af61-f84ae1c365ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:21.609886 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dd5b3-43dd-4e07-af61-f84ae1c365ed None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:21.610175 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dd5b3-43dd-4e07-af61-f84ae1c365ed None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:21.610462 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593dd5b3-43dd-4e07-af61-f84ae1c365ed None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:21.611877 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dd5b3-43dd-4e07-af61-f84ae1c365ed None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:21.613440 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593dd5b3-43dd-4e07-af61-f84ae1c365ed None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:21.614866 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d6b21c-b207-420c-9f12-9dba1d84dbb0 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:21.619893 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 150/292] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:21 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:21.621226 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dd5b3-43dd-4e07-af61-f84ae1c365ed None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:21.708590 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17cf9011-f326-46c1-8387-603ed991a741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:21.709335 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf9011-f326-46c1-8387-603ed991a741 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:21.709626 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf9011-f326-46c1-8387-603ed991a741 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:21.709904 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17cf9011-f326-46c1-8387-603ed991a741 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:21.710780 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf9011-f326-46c1-8387-603ed991a741 None admin] RBAC: Adding query filter params (role.id=0e5f3c37f30e45da98262a20b891833d, scope.project.id=6d09612017fd488a94e457afdcdec8a7, user.id=5f0136e0d64b4a3c96c5f268e35af43c) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:21.711105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf9011-f326-46c1-8387-603ed991a741 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:21.712687 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17cf9011-f326-46c1-8387-603ed991a741 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:21.732346 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 143/293] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:56:21 2022] GET /identity/v3/role_assignments?user.id=5f0136e0d64b4a3c96c5f268e35af43c&scope.project.id=6d09612017fd488a94e457afdcdec8a7&role.id=0e5f3c37f30e45da98262a20b891833d => generated 608 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:21.828004 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593dd5b3-43dd-4e07-af61-f84ae1c365ed None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:21.898495 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3ef497-989b-46ca-b7a2-16ed7dde7537 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:21.900262 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ef497-989b-46ca-b7a2-16ed7dde7537 None admin] REQUEST_METHOD: `PUT` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:21.900786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ef497-989b-46ca-b7a2-16ed7dde7537 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:21.901295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3ef497-989b-46ca-b7a2-16ed7dde7537 None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7/users/9acb8b082197447b89bd27b453b6b330/roles/040d082ba25f428a898a87057e2f7341` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:21.906037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ef497-989b-46ca-b7a2-16ed7dde7537 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d09612017fd488a94e457afdcdec8a7, user_id=9acb8b082197447b89bd27b453b6b330, role_id=040d082ba25f428a898a87057e2f7341)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:21.909432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3ef497-989b-46ca-b7a2-16ed7dde7537 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:21.948099 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 151/294] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:56:21 2022] PUT /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7/users/9acb8b082197447b89bd27b453b6b330/roles/040d082ba25f428a898a87057e2f7341 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:56:23.003124 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b03576-b940-4557-9928-76faa6fcc0db None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:23.004801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b03576-b940-4557-9928-76faa6fcc0db None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:23.005618 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b03576-b940-4557-9928-76faa6fcc0db None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:23.011044 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 144/295] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:23.020072 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d9f8f-13f3-4a42-8ed3-cc3a04a29b5b None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:23.021772 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d9f8f-13f3-4a42-8ed3-cc3a04a29b5b None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:23.022606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d9f8f-13f3-4a42-8ed3-cc3a04a29b5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:23.049753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c97ff-ba81-4f47-9ddc-141c9044d4b3 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:23.050676 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c97ff-ba81-4f47-9ddc-141c9044d4b3 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:23.051465 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938c97ff-ba81-4f47-9ddc-141c9044d4b3 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:23.054979 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 145/296] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:23.060284 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-c15d9f8f-13f3-4a42-8ed3-cc3a04a29b5b None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:23.060284 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-c15d9f8f-13f3-4a42-8ed3-cc3a04a29b5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:23.066103 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750cd35-539e-409f-a685-0604c3f771fd None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:23.067075 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750cd35-539e-409f-a685-0604c3f771fd None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:23.067848 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f750cd35-539e-409f-a685-0604c3f771fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:23.100909 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-f750cd35-539e-409f-a685-0604c3f771fd None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:23.104816 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-f750cd35-539e-409f-a685-0604c3f771fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:23.120839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:23.176988 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:23.184158 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 152/297] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:23.209546 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 146/298] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:56:23.223935 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d9f8f-13f3-4a42-8ed3-cc3a04a29b5b None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:23.243962 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750cd35-539e-409f-a685-0604c3f771fd None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:23.417864 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d9f8f-13f3-4a42-8ed3-cc3a04a29b5b None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:23.430837 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f750cd35-539e-409f-a685-0604c3f771fd None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:23.471749 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be10fec3-d6b7-4ecb-80ac-f576e611b6af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:23.473060 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10fec3-d6b7-4ecb-80ac-f576e611b6af None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:23.473646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10fec3-d6b7-4ecb-80ac-f576e611b6af None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:23.474127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be10fec3-d6b7-4ecb-80ac-f576e611b6af None admin] PATH_INFO: `/v3/domains/default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:23.474702 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7572c9-3678-4b19-bafa-69679a697b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:23.475767 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7572c9-3678-4b19-bafa-69679a697b65 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:23.476310 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10fec3-d6b7-4ecb-80ac-f576e611b6af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:23.476419 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7572c9-3678-4b19-bafa-69679a697b65 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:23.476880 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7572c9-3678-4b19-bafa-69679a697b65 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:23.479016 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be10fec3-d6b7-4ecb-80ac-f576e611b6af None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:23.482586 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 153/299] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:56:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:23.485074 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50485bd6-92e4-4be9-b53a-cacdc4e44ebd None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:23.485578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50485bd6-92e4-4be9-b53a-cacdc4e44ebd None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:23.486065 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50485bd6-92e4-4be9-b53a-cacdc4e44ebd None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:23.490362 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 154/300] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:23.490704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50485bd6-92e4-4be9-b53a-cacdc4e44ebd None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:23.499401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7572c9-3678-4b19-bafa-69679a697b65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-7e7572c9-3678-4b19-bafa-69679a697b65 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:23.508748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:23.509707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:23.510476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:23.510476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:23.510476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:23.510476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:23.510476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:23.510476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:23.510476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:23.510476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:23.510476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:23.510476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:23.510476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:23.510476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:23.510476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 147/301] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:56:23.511827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c161-efb2-4665-9c79-756014ef9068 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:23.511827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c161-efb2-4665-9c79-756014ef9068 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:23.511827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c7c161-efb2-4665-9c79-756014ef9068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:23.534212 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-e0c7c161-efb2-4665-9c79-756014ef9068 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:23.535469 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e0c7c161-efb2-4665-9c79-756014ef9068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:23.573023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:23.578350 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:23.648183 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 148/302] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:23.648183 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7c161-efb2-4665-9c79-756014ef9068 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:23.693562 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50485bd6-92e4-4be9-b53a-cacdc4e44ebd None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:23.763950 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd086ab-253c-43dc-9c7d-b87ad68575e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:23.765183 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd086ab-253c-43dc-9c7d-b87ad68575e9 None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:23.765680 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd086ab-253c-43dc-9c7d-b87ad68575e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:23.766443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd086ab-253c-43dc-9c7d-b87ad68575e9 None admin] PATH_INFO: `/v3/groups` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:23.767766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd086ab-253c-43dc-9c7d-b87ad68575e9 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:23.770663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbd086ab-253c-43dc-9c7d-b87ad68575e9 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:23.795518 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c7c161-efb2-4665-9c79-756014ef9068 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:23.798295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 155/303] 10.222.0.25 () {60 vars in 1134 bytes} [Wed May 25 07:56:23 2022] POST /identity/v3/groups => generated 229 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:56:23.799713 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd086ab-253c-43dc-9c7d-b87ad68575e9 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:23.848711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077b539-f6af-4617-a21c-c07f648a2a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:23.850379 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077b539-f6af-4617-a21c-c07f648a2a22 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:23.851142 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077b539-f6af-4617-a21c-c07f648a2a22 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:23.851799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d077b539-f6af-4617-a21c-c07f648a2a22 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:23.852949 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077b539-f6af-4617-a21c-c07f648a2a22 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:23.853491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077b539-f6af-4617-a21c-c07f648a2a22 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:23.856585 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d077b539-f6af-4617-a21c-c07f648a2a22 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:23.867829 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 149/304] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:23.881965 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077b539-f6af-4617-a21c-c07f648a2a22 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:23.957357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:23.989028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd086ab-253c-43dc-9c7d-b87ad68575e9 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:23.993543 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:24.062470 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a77b0-3882-456d-a1db-aa9537347349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:24.063886 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a77b0-3882-456d-a1db-aa9537347349 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:24.064420 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a77b0-3882-456d-a1db-aa9537347349 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:24.064914 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74a77b0-3882-456d-a1db-aa9537347349 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:24.070835 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d077b539-f6af-4617-a21c-c07f648a2a22 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:24.085917 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74a77b0-3882-456d-a1db-aa9537347349 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-c74a77b0-3882-456d-a1db-aa9537347349 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:24.101571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:24.102520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:24.103326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:24.103326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:24.103326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:24.103326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:24.103326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:24.103326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:24.103326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:24.103326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:24.103326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:24.103326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:24.103326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:24.103326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:24.104617 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 156/305] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:24.114481 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a77b0-3882-456d-a1db-aa9537347349 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:24.118597 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfb392-568c-4e66-a718-0b1aaa84405a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:24.119897 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfb392-568c-4e66-a718-0b1aaa84405a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:24.120300 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfb392-568c-4e66-a718-0b1aaa84405a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:24.120586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cfb392-568c-4e66-a718-0b1aaa84405a None admin] PATH_INFO: `/v3/users/2a21b7b8ca5e4418822d2a5fbeb35d4c` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:24.122535 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfb392-568c-4e66-a718-0b1aaa84405a None admin] RBAC: Authorizing `identity:get_user(user_id=2a21b7b8ca5e4418822d2a5fbeb35d4c)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:24.124002 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cfb392-568c-4e66-a718-0b1aaa84405a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:24.125964 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 150/306] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:23 2022] GET /identity/v3/users/2a21b7b8ca5e4418822d2a5fbeb35d4c => generated 293 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:24.132025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfb392-568c-4e66-a718-0b1aaa84405a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:24.260400 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:24.265233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cfb392-568c-4e66-a718-0b1aaa84405a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:24.312644 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe5637-8ce6-4797-af74-6feec08b9774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:24.314073 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe5637-8ce6-4797-af74-6feec08b9774 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:24.314357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe5637-8ce6-4797-af74-6feec08b9774 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:24.314642 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fe5637-8ce6-4797-af74-6feec08b9774 None admin] PATH_INFO: `/v3/system/users/2a21b7b8ca5e4418822d2a5fbeb35d4c/roles/0e5f3c37f30e45da98262a20b891833d` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:24.316641 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe5637-8ce6-4797-af74-6feec08b9774 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2a21b7b8ca5e4418822d2a5fbeb35d4c, role_id=0e5f3c37f30e45da98262a20b891833d)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:24.318065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fe5637-8ce6-4797-af74-6feec08b9774 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:24.328102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74a77b0-3882-456d-a1db-aa9537347349 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:24.344263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 151/307] 10.222.0.25 () {58 vars in 1334 bytes} [Wed May 25 07:56:24 2022] PUT /identity/v3/system/users/2a21b7b8ca5e4418822d2a5fbeb35d4c/roles/0e5f3c37f30e45da98262a20b891833d => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:56:24.406046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffa321-d3b9-4a39-bc51-99b355d2a9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:24.407715 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffa321-d3b9-4a39-bc51-99b355d2a9f0 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:24.408651 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffa321-d3b9-4a39-bc51-99b355d2a9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:24.409439 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffa321-d3b9-4a39-bc51-99b355d2a9f0 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:24.411249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffa321-d3b9-4a39-bc51-99b355d2a9f0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:24.412172 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffa321-d3b9-4a39-bc51-99b355d2a9f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:24.415386 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffa321-d3b9-4a39-bc51-99b355d2a9f0 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:24.434588 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 157/308] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:24.444573 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe5637-8ce6-4797-af74-6feec08b9774 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:24.577329 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fe5637-8ce6-4797-af74-6feec08b9774 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:24.616836 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409c979-0b99-4a78-8226-1f9514efd460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:24.617767 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409c979-0b99-4a78-8226-1f9514efd460 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:24.618047 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409c979-0b99-4a78-8226-1f9514efd460 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:24.618380 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409c979-0b99-4a78-8226-1f9514efd460 None admin] PATH_INFO: `/v3/users/4781e7ecd004463fb696fbb056401491` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:24.634767 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409c979-0b99-4a78-8226-1f9514efd460 None admin] RBAC: Authorizing `identity:get_user(user_id=4781e7ecd004463fb696fbb056401491)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:24.636303 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409c979-0b99-4a78-8226-1f9514efd460 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:24.638994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 152/309] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:24 2022] GET /identity/v3/users/4781e7ecd004463fb696fbb056401491 => generated 293 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:24.645070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffa321-d3b9-4a39-bc51-99b355d2a9f0 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:24.676113 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:24.791918 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffa321-d3b9-4a39-bc51-99b355d2a9f0 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:24.858543 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef8daf-83ab-4baf-9ec0-173565058e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:24.859561 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef8daf-83ab-4baf-9ec0-173565058e5d None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:24.859996 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef8daf-83ab-4baf-9ec0-173565058e5d None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:24.860470 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef8daf-83ab-4baf-9ec0-173565058e5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:24.861853 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef8daf-83ab-4baf-9ec0-173565058e5d None admin] RBAC: Adding query filter params (role.id=040d082ba25f428a898a87057e2f7341, user.id=4781e7ecd004463fb696fbb056401491, scope.system=all) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:24.862330 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef8daf-83ab-4baf-9ec0-173565058e5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:24.864814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ef8daf-83ab-4baf-9ec0-173565058e5d None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:24.874754 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 158/310] 10.222.0.25 () {56 vars in 1308 bytes} [Wed May 25 07:56:24 2022] GET /identity/v3/role_assignments?user.id=4781e7ecd004463fb696fbb056401491&scope.system=all&role.id=040d082ba25f428a898a87057e2f7341 => generated 226 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:25.197073 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7e783-6d96-4f53-be5a-d24ec06d5131 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:25.197586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7e783-6d96-4f53-be5a-d24ec06d5131 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:25.197927 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a7e783-6d96-4f53-be5a-d24ec06d5131 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:25.201489 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 153/311] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:25.209732 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bd98c-5d35-4e31-aeb6-e90c20d7fd8e None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:25.210514 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bd98c-5d35-4e31-aeb6-e90c20d7fd8e None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:25.210677 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845bd98c-5d35-4e31-aeb6-e90c20d7fd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:25.240036 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-845bd98c-5d35-4e31-aeb6-e90c20d7fd8e None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:25.242073 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-845bd98c-5d35-4e31-aeb6-e90c20d7fd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:25.338780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 159/312] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:25.381705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7e783-6d96-4f53-be5a-d24ec06d5131 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:25.417239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:25.572205 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a7e783-6d96-4f53-be5a-d24ec06d5131 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:25.613755 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aa896-1434-46a1-abeb-4177bbc140a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:25.614963 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aa896-1434-46a1-abeb-4177bbc140a2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:25.615474 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aa896-1434-46a1-abeb-4177bbc140a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:25.615944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827aa896-1434-46a1-abeb-4177bbc140a2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:25.629957 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827aa896-1434-46a1-abeb-4177bbc140a2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-827aa896-1434-46a1-abeb-4177bbc140a2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:25.638481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:25.639438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:25.640280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:25.640280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:25.640280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:25.640280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:25.640280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:25.640280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:25.640280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:25.640280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:25.640280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:25.640280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:25.640280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:25.640280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:25.643014 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 154/313] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:25.654112 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bd98c-5d35-4e31-aeb6-e90c20d7fd8e None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:25.689682 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:25.821240 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845bd98c-5d35-4e31-aeb6-e90c20d7fd8e None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:25.861359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e66c68-1946-400a-8b04-7553d9fd84d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:25.862051 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e66c68-1946-400a-8b04-7553d9fd84d3 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:25.862338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e66c68-1946-400a-8b04-7553d9fd84d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:25.862618 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e66c68-1946-400a-8b04-7553d9fd84d3 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:25.863386 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e66c68-1946-400a-8b04-7553d9fd84d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:25.863698 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e66c68-1946-400a-8b04-7553d9fd84d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:25.865148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e66c68-1946-400a-8b04-7553d9fd84d3 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:25.879875 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 160/314] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:25.885996 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aa896-1434-46a1-abeb-4177bbc140a2 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:25.973108 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:25.996738 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827aa896-1434-46a1-abeb-4177bbc140a2 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:26.043238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642279fa-b777-4c13-880f-61779239598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:26.045794 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642279fa-b777-4c13-880f-61779239598f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:26.047961 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642279fa-b777-4c13-880f-61779239598f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:26.047961 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642279fa-b777-4c13-880f-61779239598f None admin] PATH_INFO: `/v3/users/9acb8b082197447b89bd27b453b6b330` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:26.049632 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642279fa-b777-4c13-880f-61779239598f None admin] RBAC: Authorizing `identity:get_user(user_id=9acb8b082197447b89bd27b453b6b330)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:26.052695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642279fa-b777-4c13-880f-61779239598f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:26.056695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 155/315] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:25 2022] GET /identity/v3/users/9acb8b082197447b89bd27b453b6b330 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:26.062155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e66c68-1946-400a-8b04-7553d9fd84d3 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:26.179215 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:26.186038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e66c68-1946-400a-8b04-7553d9fd84d3 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:26.224908 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58486f28-b392-416d-afde-07829753c0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:26.225918 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58486f28-b392-416d-afde-07829753c0aa None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:26.225918 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58486f28-b392-416d-afde-07829753c0aa None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:26.226153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58486f28-b392-416d-afde-07829753c0aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:26.301508 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58486f28-b392-416d-afde-07829753c0aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:26.303046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58486f28-b392-416d-afde-07829753c0aa None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:26.395626 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:26.421521 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 161/316] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:26.432005 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642279fa-b777-4c13-880f-61779239598f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:26.595207 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642279fa-b777-4c13-880f-61779239598f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:26.634992 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4935fe-c561-4245-a912-74fe74d568bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:26.635874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4935fe-c561-4245-a912-74fe74d568bc None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:26.636179 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4935fe-c561-4245-a912-74fe74d568bc None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:26.636459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4935fe-c561-4245-a912-74fe74d568bc None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:26.638298 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4935fe-c561-4245-a912-74fe74d568bc None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:26.639879 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4935fe-c561-4245-a912-74fe74d568bc None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:26.642086 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 156/317] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:26 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:26.648198 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58486f28-b392-416d-afde-07829753c0aa None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:26.771228 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58486f28-b392-416d-afde-07829753c0aa None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:26.823685 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4e4308-a712-44ca-ba71-ce05018631f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:26.824413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e4308-a712-44ca-ba71-ce05018631f9 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:26.825295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e4308-a712-44ca-ba71-ce05018631f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:26.825580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4e4308-a712-44ca-ba71-ce05018631f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:26.826433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e4308-a712-44ca-ba71-ce05018631f9 None admin] RBAC: Adding query filter params (role.id=040d082ba25f428a898a87057e2f7341, scope.project.id=6d09612017fd488a94e457afdcdec8a7, user.id=9acb8b082197447b89bd27b453b6b330) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:26.826750 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e4308-a712-44ca-ba71-ce05018631f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:26.828248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4e4308-a712-44ca-ba71-ce05018631f9 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:26.836302 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 162/318] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:56:26 2022] GET /identity/v3/role_assignments?user.id=9acb8b082197447b89bd27b453b6b330&scope.project.id=6d09612017fd488a94e457afdcdec8a7&role.id=040d082ba25f428a898a87057e2f7341 => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:27.184493 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a75fe-8d13-41dd-9be8-3b01fde4ba2b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:27.184766 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a75fe-8d13-41dd-9be8-3b01fde4ba2b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:27.185209 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306a75fe-8d13-41dd-9be8-3b01fde4ba2b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:27.186794 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 157/319] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:27.194417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc829cc-e3ce-4cd3-ae0f-d2d1a7bbb814 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:27.194953 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc829cc-e3ce-4cd3-ae0f-d2d1a7bbb814 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:27.195264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc829cc-e3ce-4cd3-ae0f-d2d1a7bbb814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:27.215122 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-7dc829cc-e3ce-4cd3-ae0f-d2d1a7bbb814 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:27.217011 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-7dc829cc-e3ce-4cd3-ae0f-d2d1a7bbb814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:27.269521 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:27.302938 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 163/320] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:27.326394 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a75fe-8d13-41dd-9be8-3b01fde4ba2b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:27.345838 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:27.450910 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306a75fe-8d13-41dd-9be8-3b01fde4ba2b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:27.491527 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40246005-3962-499f-85b7-f99335a706d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:27.492376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40246005-3962-499f-85b7-f99335a706d3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:27.492724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40246005-3962-499f-85b7-f99335a706d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:27.493003 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40246005-3962-499f-85b7-f99335a706d3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:27.494261 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40246005-3962-499f-85b7-f99335a706d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:27.495727 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40246005-3962-499f-85b7-f99335a706d3 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:27.497467 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 158/321] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:56:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:27.504728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc829cc-e3ce-4cd3-ae0f-d2d1a7bbb814 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:27.624265 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc829cc-e3ce-4cd3-ae0f-d2d1a7bbb814 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:27.664274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f02175-50f7-49f2-972c-01d5fa3ed6f3 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:27.664794 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f02175-50f7-49f2-972c-01d5fa3ed6f3 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:27.665299 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f02175-50f7-49f2-972c-01d5fa3ed6f3 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:27.666423 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335afb8-cf74-4ba9-9dae-1d00f34aba79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:27.667129 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335afb8-cf74-4ba9-9dae-1d00f34aba79 None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:27.667406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335afb8-cf74-4ba9-9dae-1d00f34aba79 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:27.668314 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335afb8-cf74-4ba9-9dae-1d00f34aba79 None admin] PATH_INFO: `/v3/groups` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:27.668475 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 159/322] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:56:27.668729 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335afb8-cf74-4ba9-9dae-1d00f34aba79 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:27.670259 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335afb8-cf74-4ba9-9dae-1d00f34aba79 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:27.677230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cef815-255c-4add-a29b-19970e837dee None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:27.677676 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cef815-255c-4add-a29b-19970e837dee None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:27.678186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cef815-255c-4add-a29b-19970e837dee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:27.704260 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 164/323] 10.222.0.25 () {60 vars in 1134 bytes} [Wed May 25 07:56:27 2022] POST /identity/v3/groups => generated 226 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:56:27.714240 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-08cef815-255c-4add-a29b-19970e837dee None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:27.717584 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-08cef815-255c-4add-a29b-19970e837dee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:27.756402 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e5f4-c402-4bb3-82e3-b92129d58c49 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:27.756730 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e5f4-c402-4bb3-82e3-b92129d58c49 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:27.757036 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61e5f4-c402-4bb3-82e3-b92129d58c49 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:27.758741 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 165/324] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:56:27.765728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee234d7-4c30-40e4-a2b3-5e7b2e32cb8d None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:27.766371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee234d7-4c30-40e4-a2b3-5e7b2e32cb8d None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:27.766617 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee234d7-4c30-40e4-a2b3-5e7b2e32cb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:27.786526 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-7ee234d7-4c30-40e4-a2b3-5e7b2e32cb8d None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:27.787840 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-7ee234d7-4c30-40e4-a2b3-5e7b2e32cb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:27.844517 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:27.868216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 160/325] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:27.912246 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cef815-255c-4add-a29b-19970e837dee None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:27.929762 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 166/326] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:56:27.935880 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:27.953586 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee234d7-4c30-40e4-a2b3-5e7b2e32cb8d None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:28.114890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cef815-255c-4add-a29b-19970e837dee None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:28.130007 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee234d7-4c30-40e4-a2b3-5e7b2e32cb8d None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:28.178408 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f050cf-e72c-4a88-8c35-ad806b968486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:28.179667 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f050cf-e72c-4a88-8c35-ad806b968486 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:28.180142 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f050cf-e72c-4a88-8c35-ad806b968486 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:28.180634 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f050cf-e72c-4a88-8c35-ad806b968486 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:28.193857 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86eb90-c7b9-4149-85b9-3513f650a37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:28.195280 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86eb90-c7b9-4149-85b9-3513f650a37f None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:28.195750 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86eb90-c7b9-4149-85b9-3513f650a37f None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:28.196351 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86eb90-c7b9-4149-85b9-3513f650a37f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:28.201400 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f050cf-e72c-4a88-8c35-ad806b968486 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-27f050cf-e72c-4a88-8c35-ad806b968486 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:28.216006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:28.217686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:28.219233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:28.219233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:28.219233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:28.219233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:28.219233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:28.219233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:28.219233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:28.219233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:28.219233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:28.219233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:28.219233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:28.219233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:28.220405 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86eb90-c7b9-4149-85b9-3513f650a37f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:28.223519 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 161/327] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-3f86eb90-c7b9-4149-85b9-3513f650a37f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:28.231625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:28.233602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:28.235195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:28.235195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:28.235195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:28.235195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:28.235195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:28.235195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:28.235195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:28.235195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:28.235195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:28.235195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:28.235195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:28.235195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:28.235195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 167/328] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:56:28.237928 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f050cf-e72c-4a88-8c35-ad806b968486 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:28.241560 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86eb90-c7b9-4149-85b9-3513f650a37f None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:28.298561 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:28.342886 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:28.389595 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f050cf-e72c-4a88-8c35-ad806b968486 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:28.432712 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86eb90-c7b9-4149-85b9-3513f650a37f None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:28.457899 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe93a66-2cc0-42c2-8d42-89d892adb753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:28.459059 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93a66-2cc0-42c2-8d42-89d892adb753 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:28.459520 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93a66-2cc0-42c2-8d42-89d892adb753 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:28.459999 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe93a66-2cc0-42c2-8d42-89d892adb753 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:28.461429 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe93a66-2cc0-42c2-8d42-89d892adb753 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:28.461974 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe93a66-2cc0-42c2-8d42-89d892adb753 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:28.464564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe93a66-2cc0-42c2-8d42-89d892adb753 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:28.475523 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac7933-e538-4497-9fbd-10496ec7b197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:28.476302 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac7933-e538-4497-9fbd-10496ec7b197 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:28.476598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac7933-e538-4497-9fbd-10496ec7b197 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:28.476883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac7933-e538-4497-9fbd-10496ec7b197 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:28.477709 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac7933-e538-4497-9fbd-10496ec7b197 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:28.478024 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac7933-e538-4497-9fbd-10496ec7b197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:28.479524 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac7933-e538-4497-9fbd-10496ec7b197 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:28.485332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 162/329] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:28.489952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 168/330] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:28.498550 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac7933-e538-4497-9fbd-10496ec7b197 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:28.498946 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe93a66-2cc0-42c2-8d42-89d892adb753 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:28.651761 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:28.667202 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac7933-e538-4497-9fbd-10496ec7b197 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:28.707050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8958b-bc50-4456-aad0-f3cef86f2b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:28.707952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8958b-bc50-4456-aad0-f3cef86f2b3b None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:28.708262 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8958b-bc50-4456-aad0-f3cef86f2b3b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:28.708531 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8958b-bc50-4456-aad0-f3cef86f2b3b None admin] PATH_INFO: `/v3/users/4781e7ecd004463fb696fbb056401491` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:28.709827 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8958b-bc50-4456-aad0-f3cef86f2b3b None admin] RBAC: Authorizing `identity:get_user(user_id=4781e7ecd004463fb696fbb056401491)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:28.711318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8958b-bc50-4456-aad0-f3cef86f2b3b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:28.713103 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 169/331] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:28 2022] GET /identity/v3/users/4781e7ecd004463fb696fbb056401491 => generated 293 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:28.719597 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8958b-bc50-4456-aad0-f3cef86f2b3b None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:28.752968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe93a66-2cc0-42c2-8d42-89d892adb753 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:28.840380 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8958b-bc50-4456-aad0-f3cef86f2b3b None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:28.849387 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93c030-79d2-4e4a-bc37-0ab384500000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:28.851342 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c030-79d2-4e4a-bc37-0ab384500000 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:28.852201 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c030-79d2-4e4a-bc37-0ab384500000 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:28.853003 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a93c030-79d2-4e4a-bc37-0ab384500000 None admin] PATH_INFO: `/v3/users/2a21b7b8ca5e4418822d2a5fbeb35d4c` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:28.855784 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93c030-79d2-4e4a-bc37-0ab384500000 None admin] RBAC: Authorizing `identity:get_user(user_id=2a21b7b8ca5e4418822d2a5fbeb35d4c)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:28.859088 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a93c030-79d2-4e4a-bc37-0ab384500000 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:28.863239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 163/332] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:28 2022] GET /identity/v3/users/2a21b7b8ca5e4418822d2a5fbeb35d4c => generated 293 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:28.873853 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93c030-79d2-4e4a-bc37-0ab384500000 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:28.882771 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327fbe85-0504-4a0e-8544-a01bfd181058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:28.883665 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fbe85-0504-4a0e-8544-a01bfd181058 None admin] REQUEST_METHOD: `PUT` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:28.883939 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fbe85-0504-4a0e-8544-a01bfd181058 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:28.884255 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327fbe85-0504-4a0e-8544-a01bfd181058 None admin] PATH_INFO: `/v3/system/users/4781e7ecd004463fb696fbb056401491/roles/040d082ba25f428a898a87057e2f7341` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:28.885821 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fbe85-0504-4a0e-8544-a01bfd181058 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4781e7ecd004463fb696fbb056401491, role_id=040d082ba25f428a898a87057e2f7341)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:28.886787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:28.888976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327fbe85-0504-4a0e-8544-a01bfd181058 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:28.908373 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 170/333] 10.222.0.25 () {58 vars in 1334 bytes} [Wed May 25 07:56:28 2022] PUT /identity/v3/system/users/4781e7ecd004463fb696fbb056401491/roles/040d082ba25f428a898a87057e2f7341 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:56:29.100037 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a93c030-79d2-4e4a-bc37-0ab384500000 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:29.152442 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e18cad-688b-4b2d-8c4e-f9d1201d5b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:29.153205 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e18cad-688b-4b2d-8c4e-f9d1201d5b9e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:29.153491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e18cad-688b-4b2d-8c4e-f9d1201d5b9e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:29.153766 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e18cad-688b-4b2d-8c4e-f9d1201d5b9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:29.154621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e18cad-688b-4b2d-8c4e-f9d1201d5b9e None admin] RBAC: Adding query filter params (role.id=0e5f3c37f30e45da98262a20b891833d, user.id=2a21b7b8ca5e4418822d2a5fbeb35d4c, scope.system=all) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:29.154927 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e18cad-688b-4b2d-8c4e-f9d1201d5b9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:29.156439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e18cad-688b-4b2d-8c4e-f9d1201d5b9e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:29.178534 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 164/334] 10.222.0.25 () {56 vars in 1308 bytes} [Wed May 25 07:56:28 2022] GET /identity/v3/role_assignments?user.id=2a21b7b8ca5e4418822d2a5fbeb35d4c&scope.system=all&role.id=0e5f3c37f30e45da98262a20b891833d => generated 510 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:31.444053 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35586b98-fea6-4550-bc15-e949e4dcb950 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:31.444654 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35586b98-fea6-4550-bc15-e949e4dcb950 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:31.444654 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35586b98-fea6-4550-bc15-e949e4dcb950 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:31.447055 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 171/335] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:31.466818 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b52e1-2e24-4045-8eb0-ce381d586b78 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:31.468396 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b52e1-2e24-4045-8eb0-ce381d586b78 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:31.469153 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f07b52e1-2e24-4045-8eb0-ce381d586b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:31.504373 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-f07b52e1-2e24-4045-8eb0-ce381d586b78 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:31.506797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-f07b52e1-2e24-4045-8eb0-ce381d586b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:31.626443 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:31.650867 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 165/336] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:31.699918 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35586b98-fea6-4550-bc15-e949e4dcb950 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:31.741617 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:31.921662 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35586b98-fea6-4550-bc15-e949e4dcb950 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:32.007231 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade2a3-16d7-4f94-807f-389f4254b71a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:32.008820 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade2a3-16d7-4f94-807f-389f4254b71a None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:32.009282 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade2a3-16d7-4f94-807f-389f4254b71a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:32.009779 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ade2a3-16d7-4f94-807f-389f4254b71a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:32.035764 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ade2a3-16d7-4f94-807f-389f4254b71a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-78ade2a3-16d7-4f94-807f-389f4254b71a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:32.056816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:32.057769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:32.058568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:32.058568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:32.058568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:32.058568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:32.058568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:32.058568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:32.058568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:32.058568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:32.058568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:32.058568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:32.058568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:32.058568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:32.059711 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 172/337] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:56:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 361 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:32.069208 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b52e1-2e24-4045-8eb0-ce381d586b78 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:32.319095 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f07b52e1-2e24-4045-8eb0-ce381d586b78 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:32.393933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13a8deb-aea8-4164-b9b1-eb3667f19152 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:32.395043 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a8deb-aea8-4164-b9b1-eb3667f19152 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:32.395534 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a8deb-aea8-4164-b9b1-eb3667f19152 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:32.396015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13a8deb-aea8-4164-b9b1-eb3667f19152 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:32.397484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a8deb-aea8-4164-b9b1-eb3667f19152 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:32.398036 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a8deb-aea8-4164-b9b1-eb3667f19152 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:32.400747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13a8deb-aea8-4164-b9b1-eb3667f19152 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:32.418494 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 166/338] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:56:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:32.426352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade2a3-16d7-4f94-807f-389f4254b71a None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:32.473668 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3360898-6650-4eb9-babd-ac7c61b7a1c3 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:32.475277 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3360898-6650-4eb9-babd-ac7c61b7a1c3 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:32.476043 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3360898-6650-4eb9-babd-ac7c61b7a1c3 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:32.479065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 167/339] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:32.495236 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e8701-161e-4c46-968b-ec741ea1b0cd None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:32.496072 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e8701-161e-4c46-968b-ec741ea1b0cd None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:32.497596 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161e8701-161e-4c46-968b-ec741ea1b0cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:32.550085 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-161e8701-161e-4c46-968b-ec741ea1b0cd None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:32.553071 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-161e8701-161e-4c46-968b-ec741ea1b0cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:32.680690 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:32.692644 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:32.757443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ade2a3-16d7-4f94-807f-389f4254b71a None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:32.762566 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 168/340] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:32.854014 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e8701-161e-4c46-968b-ec741ea1b0cd None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:32.858770 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb4332-dae7-4009-9643-493416e99c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:32.859877 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb4332-dae7-4009-9643-493416e99c12 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:32.860405 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb4332-dae7-4009-9643-493416e99c12 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:32.860856 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cb4332-dae7-4009-9643-493416e99c12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:33.069303 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb4332-dae7-4009-9643-493416e99c12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:33.072547 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cb4332-dae7-4009-9643-493416e99c12 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:33.116375 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161e8701-161e-4c46-968b-ec741ea1b0cd None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:33.164160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7513888b-9f98-4028-baff-6e1c1d004eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:33.165493 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513888b-9f98-4028-baff-6e1c1d004eea None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:33.166043 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513888b-9f98-4028-baff-6e1c1d004eea None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:33.166521 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7513888b-9f98-4028-baff-6e1c1d004eea None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:33.180303 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7513888b-9f98-4028-baff-6e1c1d004eea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:33.187168 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-7513888b-9f98-4028-baff-6e1c1d004eea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:33.190799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:33.191685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:33.192524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:33.192524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:33.192524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:33.192524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:33.192524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:33.192524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:33.192524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:33.192524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:33.192524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:33.192524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:33.192524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:33.192524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:33.195538 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 169/341] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:56:33.197296 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a9250-3774-4c8e-87aa-26f4124f30d1 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:33.197802 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a9250-3774-4c8e-87aa-26f4124f30d1 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:33.198275 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429a9250-3774-4c8e-87aa-26f4124f30d1 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:33.200495 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 170/342] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:33.201881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb37597-36ea-40ba-a8d7-76806ddd161c None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:33.206529 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb37597-36ea-40ba-a8d7-76806ddd161c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:33.207351 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb37597-36ea-40ba-a8d7-76806ddd161c None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:33.209155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 173/343] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 784 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:33.209853 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 171/344] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:33.210431 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb4332-dae7-4009-9643-493416e99c12 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:33.211939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8fa6-bc0a-4c55-b455-7c4b8297ede5 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:33.212358 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8fa6-bc0a-4c55-b455-7c4b8297ede5 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:33.212737 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff8fa6-bc0a-4c55-b455-7c4b8297ede5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:33.236639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-f2ff8fa6-bc0a-4c55-b455-7c4b8297ede5 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:33.238220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-f2ff8fa6-bc0a-4c55-b455-7c4b8297ede5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:33.287530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:33.324936 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cb4332-dae7-4009-9643-493416e99c12 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:33.328460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 172/345] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:33.329568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff8fa6-bc0a-4c55-b455-7c4b8297ede5 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:33.364417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8c311f-90e9-4982-92b6-4155881fbaea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:33.365096 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c311f-90e9-4982-92b6-4155881fbaea None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:33.365540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c311f-90e9-4982-92b6-4155881fbaea None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:33.365964 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8c311f-90e9-4982-92b6-4155881fbaea None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:33.367060 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c311f-90e9-4982-92b6-4155881fbaea None admin] RBAC: Adding query filter params (name=member) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:33.367515 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c311f-90e9-4982-92b6-4155881fbaea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:33.369077 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8c311f-90e9-4982-92b6-4155881fbaea None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:33.379784 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 174/346] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:33.381578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06808c9d-f1a2-4f88-861a-d8b846ab82b2 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:33.382102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06808c9d-f1a2-4f88-861a-d8b846ab82b2 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:33.382603 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06808c9d-f1a2-4f88-861a-d8b846ab82b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:33.400930 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-06808c9d-f1a2-4f88-861a-d8b846ab82b2 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:33.403083 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-06808c9d-f1a2-4f88-861a-d8b846ab82b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:33.460654 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:33.487172 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff8fa6-bc0a-4c55-b455-7c4b8297ede5 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:33.517822 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 175/347] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:33.519686 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7ca27-5a54-48c2-8e6c-5ce38b3c1e89 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:33.520215 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7ca27-5a54-48c2-8e6c-5ce38b3c1e89 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:33.520816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b7ca27-5a54-48c2-8e6c-5ce38b3c1e89 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:33.522682 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 176/348] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:33.523667 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7ca27-5a54-48c2-8e6c-5ce38b3c1e89 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:33.540268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e6c11-635c-4f89-9f20-b774f2cdd565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:33.541169 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6c11-635c-4f89-9f20-b774f2cdd565 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:33.541451 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6c11-635c-4f89-9f20-b774f2cdd565 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:33.541728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9e6c11-635c-4f89-9f20-b774f2cdd565 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:33.543198 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e6c11-635c-4f89-9f20-b774f2cdd565 None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:33.544753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9e6c11-635c-4f89-9f20-b774f2cdd565 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:33.546956 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 173/349] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:33 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:33.547678 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e6c11-635c-4f89-9f20-b774f2cdd565 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:33.612503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:33.693618 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b7ca27-5a54-48c2-8e6c-5ce38b3c1e89 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:33.713746 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9e6c11-635c-4f89-9f20-b774f2cdd565 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:33.743842 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70cac2-58fb-43fa-9b59-abebc88ed312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:33.744973 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70cac2-58fb-43fa-9b59-abebc88ed312 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:33.745447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70cac2-58fb-43fa-9b59-abebc88ed312 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:33.745924 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f70cac2-58fb-43fa-9b59-abebc88ed312 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:33.774447 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcde766-faa8-468e-84e4-ed4fece9b1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:33.775979 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcde766-faa8-468e-84e4-ed4fece9b1b2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:33.776568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcde766-faa8-468e-84e4-ed4fece9b1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:33.777049 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcde766-faa8-468e-84e4-ed4fece9b1b2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:33.798278 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcde766-faa8-468e-84e4-ed4fece9b1b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-3bcde766-faa8-468e-84e4-ed4fece9b1b2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:33.807256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:33.808359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:33.809789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:33.809789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:33.809789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:33.809789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:33.809789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:33.809789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:33.809789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:33.809789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:33.809789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:33.809789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:33.809789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:33.809789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:33.811876 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 174/350] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:56:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:33.813378 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8a4f-be1c-4939-ab4b-afbed81cdcc4 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:33.813882 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8a4f-be1c-4939-ab4b-afbed81cdcc4 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:33.814377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181a8a4f-be1c-4939-ab4b-afbed81cdcc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:33.833792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-181a8a4f-be1c-4939-ab4b-afbed81cdcc4 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:33.835378 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-181a8a4f-be1c-4939-ab4b-afbed81cdcc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:33.836287 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:33.888454 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70cac2-58fb-43fa-9b59-abebc88ed312 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:33.890344 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f70cac2-58fb-43fa-9b59-abebc88ed312 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:33.990346 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 175/351] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:33.992295 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a8a4f-be1c-4939-ab4b-afbed81cdcc4 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:34.037030 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 177/352] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:34.038547 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70cac2-58fb-43fa-9b59-abebc88ed312 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:34.062848 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:34.168448 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:34.204709 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181a8a4f-be1c-4939-ab4b-afbed81cdcc4 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:34.248294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f70cac2-58fb-43fa-9b59-abebc88ed312 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:34.272522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10581ca2-1b51-475a-80c1-a4a7187c07eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:34.273024 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10581ca2-1b51-475a-80c1-a4a7187c07eb None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:34.273180 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10581ca2-1b51-475a-80c1-a4a7187c07eb None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:34.273432 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10581ca2-1b51-475a-80c1-a4a7187c07eb None admin] PATH_INFO: `/v3/groups/560aedcb8cb04a478692dc0a19a527e9` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:34.281207 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10581ca2-1b51-475a-80c1-a4a7187c07eb None admin] RBAC: Authorizing `identity:get_group(group_id=560aedcb8cb04a478692dc0a19a527e9)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:34.283083 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10581ca2-1b51-475a-80c1-a4a7187c07eb None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:34.284890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 176/353] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:33 2022] GET /identity/v3/groups/560aedcb8cb04a478692dc0a19a527e9 => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:34.285753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10581ca2-1b51-475a-80c1-a4a7187c07eb None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:34.326690 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba9035-86c8-4414-b4d5-171e2e577074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:34.328142 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba9035-86c8-4414-b4d5-171e2e577074 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:34.330159 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba9035-86c8-4414-b4d5-171e2e577074 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:34.330659 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ba9035-86c8-4414-b4d5-171e2e577074 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:34.352957 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ba9035-86c8-4414-b4d5-171e2e577074 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-89ba9035-86c8-4414-b4d5-171e2e577074 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:34.359146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:34.360926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 178/354] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:34.362443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba9035-86c8-4414-b4d5-171e2e577074 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:34.460914 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:34.475069 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10581ca2-1b51-475a-80c1-a4a7187c07eb None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:34.523316 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ba9035-86c8-4414-b4d5-171e2e577074 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:34.539877 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9db21d-5c1d-4fff-9e8d-2d16c429bec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:34.540968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9db21d-5c1d-4fff-9e8d-2d16c429bec6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:34.541412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9db21d-5c1d-4fff-9e8d-2d16c429bec6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:34.541883 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9db21d-5c1d-4fff-9e8d-2d16c429bec6 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:34.543276 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9db21d-5c1d-4fff-9e8d-2d16c429bec6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:34.543862 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9db21d-5c1d-4fff-9e8d-2d16c429bec6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:34.546216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9db21d-5c1d-4fff-9e8d-2d16c429bec6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:34.559572 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 177/355] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:56:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:34.562140 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9db21d-5c1d-4fff-9e8d-2d16c429bec6 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:34.581209 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:34.592112 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf120bf-c822-4f6d-96b1-003278c53081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:34.593815 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf120bf-c822-4f6d-96b1-003278c53081 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:34.594276 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf120bf-c822-4f6d-96b1-003278c53081 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:34.594755 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf120bf-c822-4f6d-96b1-003278c53081 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:34.596734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf120bf-c822-4f6d-96b1-003278c53081 None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:34.598463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf120bf-c822-4f6d-96b1-003278c53081 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:34.600909 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 179/356] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:34 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:34.602422 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf120bf-c822-4f6d-96b1-003278c53081 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:34.741054 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9db21d-5c1d-4fff-9e8d-2d16c429bec6 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:34.773844 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf120bf-c822-4f6d-96b1-003278c53081 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:34.801914 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf77707-b072-4271-9ed0-ea1b456f5e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:34.802744 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf77707-b072-4271-9ed0-ea1b456f5e83 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:34.803007 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf77707-b072-4271-9ed0-ea1b456f5e83 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:34.803282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf77707-b072-4271-9ed0-ea1b456f5e83 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:34.820546 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf77707-b072-4271-9ed0-ea1b456f5e83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:34.833132 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bdc2ec-1ace-4e3a-a37d-06c758fa34d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:34.834572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdc2ec-1ace-4e3a-a37d-06c758fa34d9 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:34.834704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdc2ec-1ace-4e3a-a37d-06c758fa34d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:34.835106 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bdc2ec-1ace-4e3a-a37d-06c758fa34d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:34.836575 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdc2ec-1ace-4e3a-a37d-06c758fa34d9 None admin] RBAC: Adding query filter params (group.id=560aedcb8cb04a478692dc0a19a527e9, role.id=fb458495153d4239becfaff1b68b012e, scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:34.836575 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdc2ec-1ace-4e3a-a37d-06c758fa34d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-eaf77707-b072-4271-9ed0-ea1b456f5e83 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:34.838237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:34.839091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:34.839933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:34.839933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:34.839933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:34.839933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:34.839933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:34.839933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:34.839933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:34.839933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:34.839933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:34.839933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:34.839933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:34.839933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:34.840682 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bdc2ec-1ace-4e3a-a37d-06c758fa34d9 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:34.841308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 178/357] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:34.842608 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf77707-b072-4271-9ed0-ea1b456f5e83 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:34.850832 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 180/358] 10.222.0.25 () {56 vars in 1376 bytes} [Wed May 25 07:56:34 2022] GET /identity/v3/role_assignments?group.id=560aedcb8cb04a478692dc0a19a527e9&scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b&role.id=fb458495153d4239becfaff1b68b012e => generated 260 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:34.854615 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3038e-7627-49cb-9ebd-1656ddb4f691 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:34.855089 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3038e-7627-49cb-9ebd-1656ddb4f691 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:34.855588 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3038e-7627-49cb-9ebd-1656ddb4f691 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:34.858604 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 181/359] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:34.859971 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3038e-7627-49cb-9ebd-1656ddb4f691 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:34.883938 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:35.018170 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:35.065401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf77707-b072-4271-9ed0-ea1b456f5e83 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:35.101723 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3038e-7627-49cb-9ebd-1656ddb4f691 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:35.137683 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea73b6f-4c60-49b4-a9b0-b940eb2910f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:35.138787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea73b6f-4c60-49b4-a9b0-b940eb2910f9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:35.139300 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea73b6f-4c60-49b4-a9b0-b940eb2910f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:35.139798 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea73b6f-4c60-49b4-a9b0-b940eb2910f9 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:35.141531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea73b6f-4c60-49b4-a9b0-b940eb2910f9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:35.142074 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea73b6f-4c60-49b4-a9b0-b940eb2910f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:35.144722 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea73b6f-4c60-49b4-a9b0-b940eb2910f9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:35.158696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 179/360] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:35.158696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea73b6f-4c60-49b4-a9b0-b940eb2910f9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:35.178657 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86ba85c-2ef5-4fa5-93d1-3d058ce8623e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:35.179783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ba85c-2ef5-4fa5-93d1-3d058ce8623e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:35.180366 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ba85c-2ef5-4fa5-93d1-3d058ce8623e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:35.180869 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86ba85c-2ef5-4fa5-93d1-3d058ce8623e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:35.280588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:35.320610 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea73b6f-4c60-49b4-a9b0-b940eb2910f9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:35.335129 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ba85c-2ef5-4fa5-93d1-3d058ce8623e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:35.338170 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86ba85c-2ef5-4fa5-93d1-3d058ce8623e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:35.386618 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6dcb1-edcf-499a-ba39-a6727b52d1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:35.388291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6dcb1-edcf-499a-ba39-a6727b52d1d2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:35.388776 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6dcb1-edcf-499a-ba39-a6727b52d1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:35.389251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f6dcb1-edcf-499a-ba39-a6727b52d1d2 None admin] PATH_INFO: `/v3/groups/560aedcb8cb04a478692dc0a19a527e9` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:35.391711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6dcb1-edcf-499a-ba39-a6727b52d1d2 None admin] RBAC: Authorizing `identity:get_group(group_id=560aedcb8cb04a478692dc0a19a527e9)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:35.395437 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f6dcb1-edcf-499a-ba39-a6727b52d1d2 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:35.398098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 180/361] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:35 2022] GET /identity/v3/groups/560aedcb8cb04a478692dc0a19a527e9 => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:35.399584 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6dcb1-edcf-499a-ba39-a6727b52d1d2 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:35.450167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:35.520031 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 182/362] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:35.522345 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7d441-c6ad-4676-88cf-316b5a6b4a8b None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:35.522793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7d441-c6ad-4676-88cf-316b5a6b4a8b None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:35.523240 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea7d441-c6ad-4676-88cf-316b5a6b4a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:35.552904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-7ea7d441-c6ad-4676-88cf-316b5a6b4a8b None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:35.554860 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-7ea7d441-c6ad-4676-88cf-316b5a6b4a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:35.576681 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f6dcb1-edcf-499a-ba39-a6727b52d1d2 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:35.617858 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d540e-d4b2-4b9c-bfd9-6869d2d75056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:35.618539 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d540e-d4b2-4b9c-bfd9-6869d2d75056 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:35.618826 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d540e-d4b2-4b9c-bfd9-6869d2d75056 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:35.619106 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152d540e-d4b2-4b9c-bfd9-6869d2d75056 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:35.619876 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d540e-d4b2-4b9c-bfd9-6869d2d75056 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:35.620220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d540e-d4b2-4b9c-bfd9-6869d2d75056 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:35.621685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152d540e-d4b2-4b9c-bfd9-6869d2d75056 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:35.634023 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 181/363] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:35.635768 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d540e-d4b2-4b9c-bfd9-6869d2d75056 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:35.657484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:35.691366 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 183/364] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:35.693271 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7d441-c6ad-4676-88cf-316b5a6b4a8b None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:35.839145 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152d540e-d4b2-4b9c-bfd9-6869d2d75056 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:35.854962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:35.867705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea7d441-c6ad-4676-88cf-316b5a6b4a8b None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:35.911472 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d308d-80b0-4dfe-a77a-4a170a4b8fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:35.912840 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d308d-80b0-4dfe-a77a-4a170a4b8fb9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:35.913248 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d308d-80b0-4dfe-a77a-4a170a4b8fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:35.913639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d308d-80b0-4dfe-a77a-4a170a4b8fb9 None admin] PATH_INFO: `/v3/users/4781e7ecd004463fb696fbb056401491` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:35.915309 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d308d-80b0-4dfe-a77a-4a170a4b8fb9 None admin] RBAC: Authorizing `identity:get_user(user_id=4781e7ecd004463fb696fbb056401491)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:35.917166 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d308d-80b0-4dfe-a77a-4a170a4b8fb9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:35.927322 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 182/365] 10.222.0.25 () {56 vars in 1177 bytes} [Wed May 25 07:56:35 2022] GET /identity/v3/users/4781e7ecd004463fb696fbb056401491 => generated 293 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:35.927322 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d308d-80b0-4dfe-a77a-4a170a4b8fb9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:35.935437 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb886b-deec-479f-bf75-0141aaa96810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:35.936537 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb886b-deec-479f-bf75-0141aaa96810 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:35.936991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb886b-deec-479f-bf75-0141aaa96810 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:35.937450 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb886b-deec-479f-bf75-0141aaa96810 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:35.938754 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb886b-deec-479f-bf75-0141aaa96810 None admin] RBAC: Adding query filter params (group.id=560aedcb8cb04a478692dc0a19a527e9, role.id=0e5f3c37f30e45da98262a20b891833d, scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:35.939277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb886b-deec-479f-bf75-0141aaa96810 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:35.941880 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb886b-deec-479f-bf75-0141aaa96810 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:35.960172 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 184/366] 10.222.0.25 () {56 vars in 1376 bytes} [Wed May 25 07:56:35 2022] GET /identity/v3/role_assignments?group.id=560aedcb8cb04a478692dc0a19a527e9&scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b&role.id=0e5f3c37f30e45da98262a20b891833d => generated 260 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:35.960172 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb886b-deec-479f-bf75-0141aaa96810 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:36.082108 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:36.130909 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d308d-80b0-4dfe-a77a-4a170a4b8fb9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:36.180375 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb886b-deec-479f-bf75-0141aaa96810 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:36.195762 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248aacc-0d82-4387-b2c5-4a241daa59ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:36.197451 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248aacc-0d82-4387-b2c5-4a241daa59ee None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:36.198135 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248aacc-0d82-4387-b2c5-4a241daa59ee None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:36.198673 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8248aacc-0d82-4387-b2c5-4a241daa59ee None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:36.201183 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248aacc-0d82-4387-b2c5-4a241daa59ee None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:36.204023 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8248aacc-0d82-4387-b2c5-4a241daa59ee None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:36.208063 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 183/367] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:35 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:36.209736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248aacc-0d82-4387-b2c5-4a241daa59ee None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:36.244298 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1b0d2-c0b2-4e43-9408-b1028d439b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:36.245338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1b0d2-c0b2-4e43-9408-b1028d439b07 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:36.245802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1b0d2-c0b2-4e43-9408-b1028d439b07 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:36.246964 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf1b0d2-c0b2-4e43-9408-b1028d439b07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:36.297026 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:36.359602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1b0d2-c0b2-4e43-9408-b1028d439b07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:36.361334 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf1b0d2-c0b2-4e43-9408-b1028d439b07 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:36.411722 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8248aacc-0d82-4387-b2c5-4a241daa59ee None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:36.460618 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240136b1-f3ca-4c53-ae97-a5686c48f391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:36.462283 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240136b1-f3ca-4c53-ae97-a5686c48f391 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:36.462637 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240136b1-f3ca-4c53-ae97-a5686c48f391 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:36.462983 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240136b1-f3ca-4c53-ae97-a5686c48f391 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:36.477653 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240136b1-f3ca-4c53-ae97-a5686c48f391 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-240136b1-f3ca-4c53-ae97-a5686c48f391 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:36.488220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:36.490868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 184/368] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:56:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:36.492660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240136b1-f3ca-4c53-ae97-a5686c48f391 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:36.500379 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:36.541580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 185/369] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:36.549924 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1b0d2-c0b2-4e43-9408-b1028d439b07 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:36.647596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:36.648860 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240136b1-f3ca-4c53-ae97-a5686c48f391 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:36.709032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf1b0d2-c0b2-4e43-9408-b1028d439b07 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:36.715435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf39b-4437-4b81-a95b-ea89158e6c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:36.717007 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf39b-4437-4b81-a95b-ea89158e6c9b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:36.717756 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf39b-4437-4b81-a95b-ea89158e6c9b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:36.718474 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dbf39b-4437-4b81-a95b-ea89158e6c9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:36.720396 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbf39b-4437-4b81-a95b-ea89158e6c9b None admin] RBAC: Adding query filter params (role.id=040d082ba25f428a898a87057e2f7341, user.id=4781e7ecd004463fb696fbb056401491, scope.system=all) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:36.721230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbf39b-4437-4b81-a95b-ea89158e6c9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:36.724321 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dbf39b-4437-4b81-a95b-ea89158e6c9b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:36.753257 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 185/370] 10.222.0.25 () {56 vars in 1308 bytes} [Wed May 25 07:56:36 2022] GET /identity/v3/role_assignments?user.id=4781e7ecd004463fb696fbb056401491&scope.system=all&role.id=040d082ba25f428a898a87057e2f7341 => generated 510 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:36.753257 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf39b-4437-4b81-a95b-ea89158e6c9b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:36.777091 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ea58d-b920-41d7-8825-b8959199f2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:36.778586 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ea58d-b920-41d7-8825-b8959199f2ab None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:36.782803 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ea58d-b920-41d7-8825-b8959199f2ab None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:36.782803 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ea58d-b920-41d7-8825-b8959199f2ab None admin] PATH_INFO: `/v3/groups/560aedcb8cb04a478692dc0a19a527e9` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:36.788159 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ea58d-b920-41d7-8825-b8959199f2ab None admin] RBAC: Authorizing `identity:get_group(group_id=560aedcb8cb04a478692dc0a19a527e9)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:36.788159 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ea58d-b920-41d7-8825-b8959199f2ab None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:36.788999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 186/371] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:36 2022] GET /identity/v3/groups/560aedcb8cb04a478692dc0a19a527e9 => generated 226 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:36.789865 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ea58d-b920-41d7-8825-b8959199f2ab None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:36.934956 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:36.978650 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ea58d-b920-41d7-8825-b8959199f2ab None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:37.016728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:37.028827 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e93b8c-6411-47d0-a840-5e0f8c3611d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:37.029989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93b8c-6411-47d0-a840-5e0f8c3611d5 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:37.030428 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93b8c-6411-47d0-a840-5e0f8c3611d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:37.031191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e93b8c-6411-47d0-a840-5e0f8c3611d5 None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:37.037584 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e93b8c-6411-47d0-a840-5e0f8c3611d5 None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:37.039426 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e93b8c-6411-47d0-a840-5e0f8c3611d5 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:37.041534 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 187/372] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:36 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:37.049863 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e93b8c-6411-47d0-a840-5e0f8c3611d5 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:37.063239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dbf39b-4437-4b81-a95b-ea89158e6c9b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:37.111264 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae440e7c-53d6-4ca3-b8ed-e1e09a2e683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:37.112758 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae440e7c-53d6-4ca3-b8ed-e1e09a2e683b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:37.113252 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae440e7c-53d6-4ca3-b8ed-e1e09a2e683b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:37.113682 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae440e7c-53d6-4ca3-b8ed-e1e09a2e683b None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:37.114659 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae440e7c-53d6-4ca3-b8ed-e1e09a2e683b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:37.115669 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae440e7c-53d6-4ca3-b8ed-e1e09a2e683b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:37.117397 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae440e7c-53d6-4ca3-b8ed-e1e09a2e683b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:37.130758 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 186/373] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:37.132236 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae440e7c-53d6-4ca3-b8ed-e1e09a2e683b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:37.276926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae440e7c-53d6-4ca3-b8ed-e1e09a2e683b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:37.284715 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e93b8c-6411-47d0-a840-5e0f8c3611d5 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:37.309517 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:37.327232 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe97c6-e96f-4954-905f-62a8379ed340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:37.328541 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe97c6-e96f-4954-905f-62a8379ed340 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:37.329045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe97c6-e96f-4954-905f-62a8379ed340 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:37.329528 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe97c6-e96f-4954-905f-62a8379ed340 None admin] PATH_INFO: `/v3/groups/560aedcb8cb04a478692dc0a19a527e9` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:37.332002 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe97c6-e96f-4954-905f-62a8379ed340 None admin] RBAC: Authorizing `identity:get_group(group_id=560aedcb8cb04a478692dc0a19a527e9)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:37.334340 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe97c6-e96f-4954-905f-62a8379ed340 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:37.336766 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 187/374] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:37 2022] GET /identity/v3/groups/560aedcb8cb04a478692dc0a19a527e9 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:37.338178 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe97c6-e96f-4954-905f-62a8379ed340 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:37.360155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1314d-f980-45ca-aadf-849997b511bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:37.361392 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1314d-f980-45ca-aadf-849997b511bf None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:37.361910 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1314d-f980-45ca-aadf-849997b511bf None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:37.362427 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe1314d-f980-45ca-aadf-849997b511bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:37.364091 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1314d-f980-45ca-aadf-849997b511bf None admin] RBAC: Adding query filter params (group.id=560aedcb8cb04a478692dc0a19a527e9, role.id=fb458495153d4239becfaff1b68b012e, scope.project.id=6d09612017fd488a94e457afdcdec8a7) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:37.364785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1314d-f980-45ca-aadf-849997b511bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:37.367469 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe1314d-f980-45ca-aadf-849997b511bf None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:37.379278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 188/375] 10.222.0.25 () {56 vars in 1376 bytes} [Wed May 25 07:56:37 2022] GET /identity/v3/role_assignments?group.id=560aedcb8cb04a478692dc0a19a527e9&scope.project.id=6d09612017fd488a94e457afdcdec8a7&role.id=fb458495153d4239becfaff1b68b012e => generated 260 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:37.380869 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1314d-f980-45ca-aadf-849997b511bf None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:37.610133 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:37.655233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe97c6-e96f-4954-905f-62a8379ed340 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:37.756279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe1314d-f980-45ca-aadf-849997b511bf None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:37.776350 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab7768-466e-4fcc-b776-d0041e10e5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:37.778853 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab7768-466e-4fcc-b776-d0041e10e5bd None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:37.779961 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab7768-466e-4fcc-b776-d0041e10e5bd None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:37.780934 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab7768-466e-4fcc-b776-d0041e10e5bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:37.851555 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f111d-af1f-486f-92d8-2119f59b7be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:37.853342 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f111d-af1f-486f-92d8-2119f59b7be1 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:37.854234 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f111d-af1f-486f-92d8-2119f59b7be1 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:37.855073 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125f111d-af1f-486f-92d8-2119f59b7be1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:37.857902 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f111d-af1f-486f-92d8-2119f59b7be1 None admin] RBAC: Adding query filter params (group.id=560aedcb8cb04a478692dc0a19a527e9, role.id=0e5f3c37f30e45da98262a20b891833d, scope.project.id=6d09612017fd488a94e457afdcdec8a7) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:37.858859 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f111d-af1f-486f-92d8-2119f59b7be1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:37.862206 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125f111d-af1f-486f-92d8-2119f59b7be1 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:37.882510 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 189/376] 10.222.0.25 () {56 vars in 1376 bytes} [Wed May 25 07:56:37 2022] GET /identity/v3/role_assignments?group.id=560aedcb8cb04a478692dc0a19a527e9&scope.project.id=6d09612017fd488a94e457afdcdec8a7&role.id=0e5f3c37f30e45da98262a20b891833d => generated 260 bytes in 503 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:37.936644 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:37.957048 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab7768-466e-4fcc-b776-d0041e10e5bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:37.958998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab7768-466e-4fcc-b776-d0041e10e5bd None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:38.177619 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 188/377] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 840 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:38.184510 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f111d-af1f-486f-92d8-2119f59b7be1 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:38.202265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a0394-7e91-4e16-91fc-5e70debde897 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:38.202564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a0394-7e91-4e16-91fc-5e70debde897 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:38.202808 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a0394-7e91-4e16-91fc-5e70debde897 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:38.204838 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 189/378] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:38.214049 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae07215-d805-4843-a59e-3c02881299dc None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:38.214565 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae07215-d805-4843-a59e-3c02881299dc None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:38.215588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae07215-d805-4843-a59e-3c02881299dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:38.247504 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-aae07215-d805-4843-a59e-3c02881299dc None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:38.249099 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-aae07215-d805-4843-a59e-3c02881299dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:38.457983 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125f111d-af1f-486f-92d8-2119f59b7be1 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:38.479903 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 190/379] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:38.515672 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae07215-d805-4843-a59e-3c02881299dc None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:38.518932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:38.540964 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda88e99-b8fd-4579-98a1-e14060441776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:38.542523 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda88e99-b8fd-4579-98a1-e14060441776 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:38.543071 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda88e99-b8fd-4579-98a1-e14060441776 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:38.543578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda88e99-b8fd-4579-98a1-e14060441776 None admin] PATH_INFO: `/v3/projects/93a049a9852946a29f77e99f63516cc1` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:38.551304 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda88e99-b8fd-4579-98a1-e14060441776 None admin] RBAC: Authorizing `identity:get_project(project_id=93a049a9852946a29f77e99f63516cc1)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:38.554232 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda88e99-b8fd-4579-98a1-e14060441776 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:38.562315 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 190/380] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:38 2022] GET /identity/v3/projects/93a049a9852946a29f77e99f63516cc1 => generated 344 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:38.574672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda88e99-b8fd-4579-98a1-e14060441776 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:38.588701 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:38.837453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae07215-d805-4843-a59e-3c02881299dc None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:38.846500 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda88e99-b8fd-4579-98a1-e14060441776 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:38.922560 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910254ca-81d7-48f1-8426-12194ddd210c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:38.925198 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910254ca-81d7-48f1-8426-12194ddd210c None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:38.926868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910254ca-81d7-48f1-8426-12194ddd210c None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:38.928382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910254ca-81d7-48f1-8426-12194ddd210c None admin] PATH_INFO: `/v3/groups/346d50c109b54581b80e3811277cd3d8` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:38.934973 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337dc7a-9ae5-485d-b95f-cba72643e34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:38.937021 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337dc7a-9ae5-485d-b95f-cba72643e34e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:38.941964 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337dc7a-9ae5-485d-b95f-cba72643e34e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:38.946166 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7337dc7a-9ae5-485d-b95f-cba72643e34e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:38.959067 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910254ca-81d7-48f1-8426-12194ddd210c None admin] RBAC: Authorizing `identity:get_group(group_id=346d50c109b54581b80e3811277cd3d8)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:38.962195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910254ca-81d7-48f1-8426-12194ddd210c None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:38.966004 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 191/381] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:38 2022] GET /identity/v3/groups/346d50c109b54581b80e3811277cd3d8 => generated 229 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:38.975598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910254ca-81d7-48f1-8426-12194ddd210c None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:38.978316 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7337dc7a-9ae5-485d-b95f-cba72643e34e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-7337dc7a-9ae5-485d-b95f-cba72643e34e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:38.995243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:38.997670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:38.999194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:38.999194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:38.999194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:38.999194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:38.999194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:38.999194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:38.999194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:38.999194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:38.999194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:38.999194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:38.999194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:38.999194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:38.999194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 191/382] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:56:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 484 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:39.009604 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337dc7a-9ae5-485d-b95f-cba72643e34e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:39.157219 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:39.196030 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:39.237659 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7337dc7a-9ae5-485d-b95f-cba72643e34e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:39.311763 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f41dc3-5f7b-4ca6-bee4-3c3b42f034a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:39.312841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f41dc3-5f7b-4ca6-bee4-3c3b42f034a3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:39.313290 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f41dc3-5f7b-4ca6-bee4-3c3b42f034a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:39.313752 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f41dc3-5f7b-4ca6-bee4-3c3b42f034a3 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:39.315075 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f41dc3-5f7b-4ca6-bee4-3c3b42f034a3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:39.315594 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f41dc3-5f7b-4ca6-bee4-3c3b42f034a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:39.318199 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f41dc3-5f7b-4ca6-bee4-3c3b42f034a3 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:39.335040 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 192/383] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:56:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:39.344256 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910254ca-81d7-48f1-8426-12194ddd210c None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:39.353742 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f41dc3-5f7b-4ca6-bee4-3c3b42f034a3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:39.475228 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a46b9f-baa0-4885-bcef-c9351828da86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:39.476310 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a46b9f-baa0-4885-bcef-c9351828da86 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:39.477296 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a46b9f-baa0-4885-bcef-c9351828da86 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:39.477795 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a46b9f-baa0-4885-bcef-c9351828da86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:39.479442 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a46b9f-baa0-4885-bcef-c9351828da86 None admin] RBAC: Adding query filter params (group.id=346d50c109b54581b80e3811277cd3d8, role.id=5c1382efdc2e4eebaf5f15a4cdae58e0, scope.project.id=93a049a9852946a29f77e99f63516cc1) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:39.479995 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a46b9f-baa0-4885-bcef-c9351828da86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:39.483348 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a46b9f-baa0-4885-bcef-c9351828da86 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:39.509150 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 192/384] 10.222.0.25 () {56 vars in 1376 bytes} [Wed May 25 07:56:38 2022] GET /identity/v3/role_assignments?group.id=346d50c109b54581b80e3811277cd3d8&scope.project.id=93a049a9852946a29f77e99f63516cc1&role.id=5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 260 bytes in 534 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:39.588902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f41dc3-5f7b-4ca6-bee4-3c3b42f034a3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:39.628234 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c91948-6215-4b6e-a6f0-289f358be591 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:39.628915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c91948-6215-4b6e-a6f0-289f358be591 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:39.629514 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c91948-6215-4b6e-a6f0-289f358be591 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:39.633582 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 193/385] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:39.646796 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f0acf-ff18-4432-a3ac-8f5cfa9a9b3d None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:39.647423 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f0acf-ff18-4432-a3ac-8f5cfa9a9b3d None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:39.652668 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f0acf-ff18-4432-a3ac-8f5cfa9a9b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:39.679718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8a955-1b56-485e-bc75-6e983cc73524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:39.681453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8a955-1b56-485e-bc75-6e983cc73524 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:39.681958 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8a955-1b56-485e-bc75-6e983cc73524 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:39.682474 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a8a955-1b56-485e-bc75-6e983cc73524 None admin] PATH_INFO: `/v3/groups/560aedcb8cb04a478692dc0a19a527e9` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:39.685175 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8a955-1b56-485e-bc75-6e983cc73524 None admin] RBAC: Authorizing `identity:get_group(group_id=560aedcb8cb04a478692dc0a19a527e9)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:39.688183 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a8a955-1b56-485e-bc75-6e983cc73524 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:39.691993 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 193/386] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:39 2022] GET /identity/v3/groups/560aedcb8cb04a478692dc0a19a527e9 => generated 226 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:39.701446 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8a955-1b56-485e-bc75-6e983cc73524 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:39.704455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-626f0acf-ff18-4432-a3ac-8f5cfa9a9b3d None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:39.706469 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-626f0acf-ff18-4432-a3ac-8f5cfa9a9b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:39.754833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:39.929051 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a8a955-1b56-485e-bc75-6e983cc73524 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:39.944185 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 194/387] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:56:39.994374 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f0acf-ff18-4432-a3ac-8f5cfa9a9b3d None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:40.026608 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9cf56-95b8-4543-984e-7cc9e5d64db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:40.031943 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9cf56-95b8-4543-984e-7cc9e5d64db2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:40.032793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9cf56-95b8-4543-984e-7cc9e5d64db2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:40.033670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f9cf56-95b8-4543-984e-7cc9e5d64db2 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:40.040635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9cf56-95b8-4543-984e-7cc9e5d64db2 None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:40.043838 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f9cf56-95b8-4543-984e-7cc9e5d64db2 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:40.058223 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 194/388] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:39 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:40.070015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9cf56-95b8-4543-984e-7cc9e5d64db2 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:40.162578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:40.294461 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f0acf-ff18-4432-a3ac-8f5cfa9a9b3d None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:40.372695 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2c712-2d69-47a3-a7e1-51c225b3df73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:40.375483 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2c712-2d69-47a3-a7e1-51c225b3df73 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:40.376345 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2c712-2d69-47a3-a7e1-51c225b3df73 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:40.377120 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b2c712-2d69-47a3-a7e1-51c225b3df73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:40.400636 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b2c712-2d69-47a3-a7e1-51c225b3df73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:40.411694 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-94b2c712-2d69-47a3-a7e1-51c225b3df73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:40.419728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:40.421726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:40.423352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:40.423352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:40.423352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:40.423352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:40.423352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:40.423352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:40.423352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:40.423352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:40.423352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:40.423352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:40.423352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:40.423352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:40.428855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 195/389] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 435 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:56:40.440436 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2c712-2d69-47a3-a7e1-51c225b3df73 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:40.454890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f9cf56-95b8-4543-984e-7cc9e5d64db2 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:40.499528 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cf9c3-7061-4526-9890-03fb635367b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:40.499799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cf9c3-7061-4526-9890-03fb635367b9 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:40.499977 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cf9c3-7061-4526-9890-03fb635367b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:40.500388 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cf9c3-7061-4526-9890-03fb635367b9 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b/groups/560aedcb8cb04a478692dc0a19a527e9/roles/fb458495153d4239becfaff1b68b012e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:40.506250 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cf9c3-7061-4526-9890-03fb635367b9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b49bdd94998e4f67af5ef2d3eb963c3b, group_id=560aedcb8cb04a478692dc0a19a527e9, role_id=fb458495153d4239becfaff1b68b012e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:40.507735 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84cf9c3-7061-4526-9890-03fb635367b9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:40.536748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 195/390] 10.222.0.25 () {58 vars in 1442 bytes} [Wed May 25 07:56:40 2022] PUT /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b/groups/560aedcb8cb04a478692dc0a19a527e9/roles/fb458495153d4239becfaff1b68b012e => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:56:40.647804 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b2c712-2d69-47a3-a7e1-51c225b3df73 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:40.667485 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:40.716161 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39fc63-4280-4cd4-a79d-b1dbf5751f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:40.717538 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39fc63-4280-4cd4-a79d-b1dbf5751f1f None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:40.718035 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39fc63-4280-4cd4-a79d-b1dbf5751f1f None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:40.718498 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d39fc63-4280-4cd4-a79d-b1dbf5751f1f None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:40.719914 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39fc63-4280-4cd4-a79d-b1dbf5751f1f None admin] RBAC: Adding query filter params (name=member) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:40.720672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39fc63-4280-4cd4-a79d-b1dbf5751f1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:40.723093 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d39fc63-4280-4cd4-a79d-b1dbf5751f1f None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:40.748048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 196/391] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:40.753572 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cf9c3-7061-4526-9890-03fb635367b9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:41.030332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cf9c3-7061-4526-9890-03fb635367b9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:41.112696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b166d89-a1f3-4685-a6d3-81fcee4824e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:41.114632 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b166d89-a1f3-4685-a6d3-81fcee4824e8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:41.115437 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b166d89-a1f3-4685-a6d3-81fcee4824e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:41.120316 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b166d89-a1f3-4685-a6d3-81fcee4824e8 None admin] PATH_INFO: `/v3/groups/560aedcb8cb04a478692dc0a19a527e9` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:41.123167 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b166d89-a1f3-4685-a6d3-81fcee4824e8 None admin] RBAC: Authorizing `identity:get_group(group_id=560aedcb8cb04a478692dc0a19a527e9)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:41.126169 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b166d89-a1f3-4685-a6d3-81fcee4824e8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:41.133934 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 196/392] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:40 2022] GET /identity/v3/groups/560aedcb8cb04a478692dc0a19a527e9 => generated 226 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:41.144062 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39fc63-4280-4cd4-a79d-b1dbf5751f1f None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:41.425889 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d39fc63-4280-4cd4-a79d-b1dbf5751f1f None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:41.506760 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6773f2fe-0f2b-475b-a734-6ff75e3f673c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:41.508214 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773f2fe-0f2b-475b-a734-6ff75e3f673c None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:41.508679 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773f2fe-0f2b-475b-a734-6ff75e3f673c None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:41.509146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6773f2fe-0f2b-475b-a734-6ff75e3f673c None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:41.517411 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773f2fe-0f2b-475b-a734-6ff75e3f673c None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:41.520260 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6773f2fe-0f2b-475b-a734-6ff75e3f673c None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:41.523694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 197/393] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:41 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 381 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:41.534818 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b166d89-a1f3-4685-a6d3-81fcee4824e8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:41.559563 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:41.748426 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b166d89-a1f3-4685-a6d3-81fcee4824e8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:41.754937 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa342c9c-fb8a-4fb8-a611-685e678fef40 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:41.755433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa342c9c-fb8a-4fb8-a611-685e678fef40 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:41.755864 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa342c9c-fb8a-4fb8-a611-685e678fef40 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:41.763277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 198/394] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:56:41.773389 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfa052-4c4a-49b5-84f5-97b08d716101 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:41.773865 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfa052-4c4a-49b5-84f5-97b08d716101 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:41.774355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dfa052-4c4a-49b5-84f5-97b08d716101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:41.837953 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-75dfa052-4c4a-49b5-84f5-97b08d716101 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:41.840102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-75dfa052-4c4a-49b5-84f5-97b08d716101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:41.866326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9015c1-821d-4db8-8158-55ca577d4942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:41.867877 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9015c1-821d-4db8-8158-55ca577d4942 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:41.868399 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9015c1-821d-4db8-8158-55ca577d4942 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:41.868886 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9015c1-821d-4db8-8158-55ca577d4942 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b/groups/560aedcb8cb04a478692dc0a19a527e9/roles/0e5f3c37f30e45da98262a20b891833d` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:41.877730 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9015c1-821d-4db8-8158-55ca577d4942 None admin] RBAC: Authorizing `identity:create_grant(project_id=b49bdd94998e4f67af5ef2d3eb963c3b, group_id=560aedcb8cb04a478692dc0a19a527e9, role_id=0e5f3c37f30e45da98262a20b891833d)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:41.880480 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9015c1-821d-4db8-8158-55ca577d4942 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:41.922242 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 197/395] 10.222.0.25 () {58 vars in 1442 bytes} [Wed May 25 07:56:41 2022] PUT /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b/groups/560aedcb8cb04a478692dc0a19a527e9/roles/0e5f3c37f30e45da98262a20b891833d => generated 0 bytes in 389 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:56:41.942934 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:42.006356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 199/396] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:56:42.084141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9015c1-821d-4db8-8158-55ca577d4942 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:42.179344 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257e78-d37c-4f94-845a-e15f41761d74 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:42.179856 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257e78-d37c-4f94-845a-e15f41761d74 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:42.180689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd257e78-d37c-4f94-845a-e15f41761d74 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:42.184770 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 200/397] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:56:42.193110 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce0935-0397-4ff6-9c0a-88c6fb51e918 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:42.194620 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:42.195392 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce0935-0397-4ff6-9c0a-88c6fb51e918 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:42.197403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dce0935-0397-4ff6-9c0a-88c6fb51e918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:42.250319 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-0dce0935-0397-4ff6-9c0a-88c6fb51e918 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:42.252484 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-0dce0935-0397-4ff6-9c0a-88c6fb51e918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:42.280581 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9015c1-821d-4db8-8158-55ca577d4942 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:42.351113 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34284c1-6e08-4939-9d8a-c9bd3000195b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:42.352037 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34284c1-6e08-4939-9d8a-c9bd3000195b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:42.352485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34284c1-6e08-4939-9d8a-c9bd3000195b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:42.352776 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34284c1-6e08-4939-9d8a-c9bd3000195b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:42.374427 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34284c1-6e08-4939-9d8a-c9bd3000195b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-e34284c1-6e08-4939-9d8a-c9bd3000195b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:42.393010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:42.394640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:42.396109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:42.396109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:42.396109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:42.396109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:42.396109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:42.396109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:42.396109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:42.396109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:42.396109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:42.396109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:42.396109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:42.396109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:42.404344 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 198/398] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:56:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:42.405320 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34284c1-6e08-4939-9d8a-c9bd3000195b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:42.416864 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 201/399] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:42.457994 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce0935-0397-4ff6-9c0a-88c6fb51e918 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:42.568422 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:42.573117 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dce0935-0397-4ff6-9c0a-88c6fb51e918 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:42.672716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c72c8-7bd7-4f60-8a4a-d05c162ad5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:42.674632 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c72c8-7bd7-4f60-8a4a-d05c162ad5c3 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:42.675356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c72c8-7bd7-4f60-8a4a-d05c162ad5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:42.676055 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69c72c8-7bd7-4f60-8a4a-d05c162ad5c3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:42.715413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69c72c8-7bd7-4f60-8a4a-d05c162ad5c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-f69c72c8-7bd7-4f60-8a4a-d05c162ad5c3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:42.739488 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:42.741257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:42.742745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:42.742745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:42.742745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:42.742745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:42.742745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:42.742745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:42.742745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:42.742745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:42.742745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:42.742745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:42.742745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:42.742745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:42.745489 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34284c1-6e08-4939-9d8a-c9bd3000195b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:42.747376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 202/400] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:42.757035 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c72c8-7bd7-4f60-8a4a-d05c162ad5c3 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:42.799169 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:42.833522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d065ef9-c0fe-4a76-a1bd-a9a0cc7a1980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:42.834620 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d065ef9-c0fe-4a76-a1bd-a9a0cc7a1980 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:42.835133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d065ef9-c0fe-4a76-a1bd-a9a0cc7a1980 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:42.835636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d065ef9-c0fe-4a76-a1bd-a9a0cc7a1980 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:42.837139 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d065ef9-c0fe-4a76-a1bd-a9a0cc7a1980 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:42.837704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d065ef9-c0fe-4a76-a1bd-a9a0cc7a1980 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:42.849335 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d065ef9-c0fe-4a76-a1bd-a9a0cc7a1980 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:42.878064 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 199/401] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:56:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 473 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:42.891397 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d065ef9-c0fe-4a76-a1bd-a9a0cc7a1980 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:42.962466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69c72c8-7bd7-4f60-8a4a-d05c162ad5c3 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:43.030528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ac4ad-699b-4e99-9f3b-ea05102497bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:43.032271 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ac4ad-699b-4e99-9f3b-ea05102497bc None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:43.033107 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ac4ad-699b-4e99-9f3b-ea05102497bc None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:43.033829 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9ac4ad-699b-4e99-9f3b-ea05102497bc None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:43.035577 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ac4ad-699b-4e99-9f3b-ea05102497bc None admin] RBAC: Adding query filter params (name=member) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:43.036516 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ac4ad-699b-4e99-9f3b-ea05102497bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:43.039478 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9ac4ad-699b-4e99-9f3b-ea05102497bc None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:43.056814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 203/402] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:43.078854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ac4ad-699b-4e99-9f3b-ea05102497bc None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:43.119138 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:43.207002 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d065ef9-c0fe-4a76-a1bd-a9a0cc7a1980 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:43.293498 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69925c-94cf-44ba-8dc4-a5d789f31731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:43.295857 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69925c-94cf-44ba-8dc4-a5d789f31731 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:43.296728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69925c-94cf-44ba-8dc4-a5d789f31731 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:43.297471 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b69925c-94cf-44ba-8dc4-a5d789f31731 None admin] PATH_INFO: `/v3/groups/560aedcb8cb04a478692dc0a19a527e9` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:43.298196 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9ac4ad-699b-4e99-9f3b-ea05102497bc None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:43.300115 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69925c-94cf-44ba-8dc4-a5d789f31731 None admin] RBAC: Authorizing `identity:get_group(group_id=560aedcb8cb04a478692dc0a19a527e9)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:43.302875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b69925c-94cf-44ba-8dc4-a5d789f31731 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:43.306512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 200/403] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:42 2022] GET /identity/v3/groups/560aedcb8cb04a478692dc0a19a527e9 => generated 226 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:43.315344 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69925c-94cf-44ba-8dc4-a5d789f31731 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:43.373300 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43185e4-e4c0-406f-9f1b-2d8cff94f00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:43.374601 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43185e4-e4c0-406f-9f1b-2d8cff94f00b None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:43.375042 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43185e4-e4c0-406f-9f1b-2d8cff94f00b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:43.375485 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43185e4-e4c0-406f-9f1b-2d8cff94f00b None admin] PATH_INFO: `/v3/groups/560aedcb8cb04a478692dc0a19a527e9` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:43.380061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43185e4-e4c0-406f-9f1b-2d8cff94f00b None admin] RBAC: Authorizing `identity:get_group(group_id=560aedcb8cb04a478692dc0a19a527e9)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:43.382493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43185e4-e4c0-406f-9f1b-2d8cff94f00b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:43.393870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 204/404] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:43 2022] GET /identity/v3/groups/560aedcb8cb04a478692dc0a19a527e9 => generated 226 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:43.402773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43185e4-e4c0-406f-9f1b-2d8cff94f00b None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:43.452213 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:43.546902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b69925c-94cf-44ba-8dc4-a5d789f31731 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:43.631013 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ba525-fb5b-4d0e-aa64-d298358a1cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:43.633129 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ba525-fb5b-4d0e-aa64-d298358a1cfc None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:43.633894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ba525-fb5b-4d0e-aa64-d298358a1cfc None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:43.634619 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867ba525-fb5b-4d0e-aa64-d298358a1cfc None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:43.640170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ba525-fb5b-4d0e-aa64-d298358a1cfc None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:43.641065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867ba525-fb5b-4d0e-aa64-d298358a1cfc None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:43.644424 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 201/405] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:43 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:43.657237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ba525-fb5b-4d0e-aa64-d298358a1cfc None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:43.672036 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:43.690998 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43185e4-e4c0-406f-9f1b-2d8cff94f00b None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:43.798367 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb07a7-af2b-4a40-b64a-b3f0ea080e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:43.799922 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb07a7-af2b-4a40-b64a-b3f0ea080e3b None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:43.800478 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb07a7-af2b-4a40-b64a-b3f0ea080e3b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:43.801138 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63eb07a7-af2b-4a40-b64a-b3f0ea080e3b None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:43.803426 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb07a7-af2b-4a40-b64a-b3f0ea080e3b None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:43.806499 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63eb07a7-af2b-4a40-b64a-b3f0ea080e3b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:43.810245 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 205/406] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:43 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:43.819728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb07a7-af2b-4a40-b64a-b3f0ea080e3b None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:43.942155 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867ba525-fb5b-4d0e-aa64-d298358a1cfc None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:44.005542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:44.024341 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8144227-7769-4f81-bdf5-a2a175ed71d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:44.026450 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8144227-7769-4f81-bdf5-a2a175ed71d8 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:44.028282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8144227-7769-4f81-bdf5-a2a175ed71d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:44.029016 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8144227-7769-4f81-bdf5-a2a175ed71d8 None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7/groups/560aedcb8cb04a478692dc0a19a527e9/roles/fb458495153d4239becfaff1b68b012e` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:44.033672 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8144227-7769-4f81-bdf5-a2a175ed71d8 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d09612017fd488a94e457afdcdec8a7, group_id=560aedcb8cb04a478692dc0a19a527e9, role_id=fb458495153d4239becfaff1b68b012e)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:44.036899 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8144227-7769-4f81-bdf5-a2a175ed71d8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:44.057639 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63eb07a7-af2b-4a40-b64a-b3f0ea080e3b None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:44.068899 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 202/407] 10.222.0.25 () {58 vars in 1442 bytes} [Wed May 25 07:56:43 2022] PUT /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7/groups/560aedcb8cb04a478692dc0a19a527e9/roles/fb458495153d4239becfaff1b68b012e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:56:44.071905 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4299a-f659-427a-b6af-84eb015e9035 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:44.072637 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4299a-f659-427a-b6af-84eb015e9035 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:44.073248 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a4299a-f659-427a-b6af-84eb015e9035 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:44.076939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 203/408] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:44 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:44.085195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41314c0-d0f2-4ac8-a792-a92e8b7ac2b9 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:44.085195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41314c0-d0f2-4ac8-a792-a92e8b7ac2b9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:44.085195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41314c0-d0f2-4ac8-a792-a92e8b7ac2b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:44.136625 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-e41314c0-d0f2-4ac8-a792-a92e8b7ac2b9 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:44.138635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e41314c0-d0f2-4ac8-a792-a92e8b7ac2b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:44.197391 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03488c1-d9d8-4938-bf98-a7fb5c50e99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:44.199600 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03488c1-d9d8-4938-bf98-a7fb5c50e99b None admin] REQUEST_METHOD: `PUT` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:44.200111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03488c1-d9d8-4938-bf98-a7fb5c50e99b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:44.200655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03488c1-d9d8-4938-bf98-a7fb5c50e99b None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7/groups/560aedcb8cb04a478692dc0a19a527e9/roles/0e5f3c37f30e45da98262a20b891833d` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:44.204809 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03488c1-d9d8-4938-bf98-a7fb5c50e99b None admin] RBAC: Authorizing `identity:create_grant(project_id=6d09612017fd488a94e457afdcdec8a7, group_id=560aedcb8cb04a478692dc0a19a527e9, role_id=0e5f3c37f30e45da98262a20b891833d)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:44.208361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03488c1-d9d8-4938-bf98-a7fb5c50e99b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:44.253750 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 206/409] 10.222.0.25 () {58 vars in 1442 bytes} [Wed May 25 07:56:43 2022] PUT /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7/groups/560aedcb8cb04a478692dc0a19a527e9/roles/0e5f3c37f30e45da98262a20b891833d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 07:56:44.340398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 204/410] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:56:44.366455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03488c1-d9d8-4938-bf98-a7fb5c50e99b None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:44.410910 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:44.605722 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03488c1-d9d8-4938-bf98-a7fb5c50e99b None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:44.677073 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683e3e-2fd9-4055-ac71-eb57d078c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:44.678392 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683e3e-2fd9-4055-ac71-eb57d078c645 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:44.678905 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683e3e-2fd9-4055-ac71-eb57d078c645 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:44.679411 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80683e3e-2fd9-4055-ac71-eb57d078c645 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:44.706216 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80683e3e-2fd9-4055-ac71-eb57d078c645 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-80683e3e-2fd9-4055-ac71-eb57d078c645 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:44.726625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:44.727689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:44.728493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:44.728493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:44.728493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:44.728493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:44.728493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:44.728493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:44.728493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:44.728493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:44.728493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:44.728493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:44.728493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:56:44.728493 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:44.729438 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 207/411] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:56:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 364 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:44.739043 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41314c0-d0f2-4ac8-a792-a92e8b7ac2b9 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:44.991662 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41314c0-d0f2-4ac8-a792-a92e8b7ac2b9 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:45.027071 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:45.065181 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a2f62-f09e-4a77-a329-6ab4abcf0da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:45.066306 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a2f62-f09e-4a77-a329-6ab4abcf0da7 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:45.066755 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a2f62-f09e-4a77-a329-6ab4abcf0da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:45.067213 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288a2f62-f09e-4a77-a329-6ab4abcf0da7 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:45.068635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a2f62-f09e-4a77-a329-6ab4abcf0da7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:45.069188 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a2f62-f09e-4a77-a329-6ab4abcf0da7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:45.071705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288a2f62-f09e-4a77-a329-6ab4abcf0da7 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:45.089944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 205/412] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:45.100242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683e3e-2fd9-4055-ac71-eb57d078c645 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:45.302475 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:45.361084 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80683e3e-2fd9-4055-ac71-eb57d078c645 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:45.445790 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ec88a3-36ce-43f7-b0d4-53f8105b88d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:45.447333 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec88a3-36ce-43f7-b0d4-53f8105b88d3 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:45.447835 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec88a3-36ce-43f7-b0d4-53f8105b88d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:45.448325 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ec88a3-36ce-43f7-b0d4-53f8105b88d3 None admin] PATH_INFO: `/v3/groups/346d50c109b54581b80e3811277cd3d8` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:45.453563 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec88a3-36ce-43f7-b0d4-53f8105b88d3 None admin] RBAC: Authorizing `identity:get_group(group_id=346d50c109b54581b80e3811277cd3d8)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:45.456343 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ec88a3-36ce-43f7-b0d4-53f8105b88d3 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:45.460231 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 208/413] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:45 2022] GET /identity/v3/groups/346d50c109b54581b80e3811277cd3d8 => generated 229 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:45.469897 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a2f62-f09e-4a77-a329-6ab4abcf0da7 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:45.553657 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e97325-ef5f-4ab7-81d6-2299877d10ec None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:45.554034 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e97325-ef5f-4ab7-81d6-2299877d10ec None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:45.554461 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e97325-ef5f-4ab7-81d6-2299877d10ec None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:45.561358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 209/414] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:45 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:45.582075 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c648a9-7bd1-45e0-a92b-42d4d1b388f4 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:45.583047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c648a9-7bd1-45e0-a92b-42d4d1b388f4 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:45.583838 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c648a9-7bd1-45e0-a92b-42d4d1b388f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:45.646341 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-11c648a9-7bd1-45e0-a92b-42d4d1b388f4 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:45.648732 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-11c648a9-7bd1-45e0-a92b-42d4d1b388f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:45.691307 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288a2f62-f09e-4a77-a329-6ab4abcf0da7 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:45.771691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79eed18-7145-45a4-ace5-e6c76188eaf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:45.772619 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eed18-7145-45a4-ace5-e6c76188eaf9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:45.772903 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eed18-7145-45a4-ace5-e6c76188eaf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:45.773180 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79eed18-7145-45a4-ace5-e6c76188eaf9 None admin] PATH_INFO: `/v3/projects/93a049a9852946a29f77e99f63516cc1` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:45.777230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79eed18-7145-45a4-ace5-e6c76188eaf9 None admin] RBAC: Authorizing `identity:get_project(project_id=93a049a9852946a29f77e99f63516cc1)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:45.786640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79eed18-7145-45a4-ace5-e6c76188eaf9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:45.792001 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 206/415] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:45 2022] GET /identity/v3/projects/93a049a9852946a29f77e99f63516cc1 => generated 344 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:45.800604 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79eed18-7145-45a4-ace5-e6c76188eaf9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:45.845511 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 210/416] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:56:45.889019 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c648a9-7bd1-45e0-a92b-42d4d1b388f4 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:45.902159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:45.978077 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79eed18-7145-45a4-ace5-e6c76188eaf9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:45.997277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:46.033224 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c648a9-7bd1-45e0-a92b-42d4d1b388f4 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:46.037282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875445ba-6aa2-4a99-933d-0a812d29cf02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:46.039424 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875445ba-6aa2-4a99-933d-0a812d29cf02 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:46.039880 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875445ba-6aa2-4a99-933d-0a812d29cf02 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:46.040355 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875445ba-6aa2-4a99-933d-0a812d29cf02 None admin] PATH_INFO: `/v3/projects/93a049a9852946a29f77e99f63516cc1/groups/346d50c109b54581b80e3811277cd3d8/roles/5c1382efdc2e4eebaf5f15a4cdae58e0` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:46.043319 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875445ba-6aa2-4a99-933d-0a812d29cf02 None admin] RBAC: Authorizing `identity:create_grant(project_id=93a049a9852946a29f77e99f63516cc1, group_id=346d50c109b54581b80e3811277cd3d8, role_id=5c1382efdc2e4eebaf5f15a4cdae58e0)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:46.045795 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875445ba-6aa2-4a99-933d-0a812d29cf02 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:46.072747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 207/417] 10.222.0.25 () {58 vars in 1442 bytes} [Wed May 25 07:56:45 2022] PUT /identity/v3/projects/93a049a9852946a29f77e99f63516cc1/groups/346d50c109b54581b80e3811277cd3d8/roles/5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:56:46.072747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9681f9-2318-427a-81db-50099190e3c9 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:46.072747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9681f9-2318-427a-81db-50099190e3c9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:46.072747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9681f9-2318-427a-81db-50099190e3c9 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:46.072747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 208/418] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:46.079157 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576561b-897a-462c-86d2-43d34e788f57 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:46.079453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576561b-897a-462c-86d2-43d34e788f57 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:46.079902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d576561b-897a-462c-86d2-43d34e788f57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:46.104950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-d576561b-897a-462c-86d2-43d34e788f57 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:46.105719 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54172fe0-1201-4835-940b-bd083a68f9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:46.106683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54172fe0-1201-4835-940b-bd083a68f9c5 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:46.107144 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54172fe0-1201-4835-940b-bd083a68f9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:46.107619 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54172fe0-1201-4835-940b-bd083a68f9c5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:46.107958 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-d576561b-897a-462c-86d2-43d34e788f57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:46.139301 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54172fe0-1201-4835-940b-bd083a68f9c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-54172fe0-1201-4835-940b-bd083a68f9c5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:46.156278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:46.157941 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:46.158949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:46.158949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:46.158949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:46.158949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:46.158949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:46.158949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:46.158949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:46.158949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:46.158949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:46.158949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:46.158949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:46.158949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:46.164891 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 211/419] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:56:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:46.169191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54172fe0-1201-4835-940b-bd083a68f9c5 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:46.211610 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 209/420] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:46.242937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576561b-897a-462c-86d2-43d34e788f57 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:46.291888 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:46.383725 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d576561b-897a-462c-86d2-43d34e788f57 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:46.428106 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a70b1-95ac-489b-8d42-4e375e4abb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:46.428888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54172fe0-1201-4835-940b-bd083a68f9c5 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:46.429432 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a70b1-95ac-489b-8d42-4e375e4abb41 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:46.429938 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a70b1-95ac-489b-8d42-4e375e4abb41 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:46.430364 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235a70b1-95ac-489b-8d42-4e375e4abb41 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:46.444798 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235a70b1-95ac-489b-8d42-4e375e4abb41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-235a70b1-95ac-489b-8d42-4e375e4abb41 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:46.454674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:46.455790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:46.456639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:46.456639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:46.456639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:46.456639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:46.456639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:46.456639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:46.456639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:46.456639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:46.456639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:46.456639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:46.456639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:46.456639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:46.459113 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 210/421] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:46.466048 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a70b1-95ac-489b-8d42-4e375e4abb41 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:46.475705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278122c-bcc7-4cef-8abf-9fa7240ea165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:46.476433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278122c-bcc7-4cef-8abf-9fa7240ea165 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:46.476718 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278122c-bcc7-4cef-8abf-9fa7240ea165 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:46.476996 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278122c-bcc7-4cef-8abf-9fa7240ea165 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:46.477801 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278122c-bcc7-4cef-8abf-9fa7240ea165 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:46.478109 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278122c-bcc7-4cef-8abf-9fa7240ea165 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:46.480944 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278122c-bcc7-4cef-8abf-9fa7240ea165 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:46.482665 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:46.493420 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 212/422] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:56:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:46.500501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278122c-bcc7-4cef-8abf-9fa7240ea165 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:46.594609 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:46.604148 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235a70b1-95ac-489b-8d42-4e375e4abb41 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:46.636840 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278122c-bcc7-4cef-8abf-9fa7240ea165 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:46.673511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00145dcb-0aeb-4564-906f-31f465c1a342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:46.674859 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00145dcb-0aeb-4564-906f-31f465c1a342 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:46.675492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00145dcb-0aeb-4564-906f-31f465c1a342 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:46.676462 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00145dcb-0aeb-4564-906f-31f465c1a342 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:46.678237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00145dcb-0aeb-4564-906f-31f465c1a342 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:46.679028 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00145dcb-0aeb-4564-906f-31f465c1a342 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:46.679164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2121c5-1db0-4977-b770-712754b50086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:46.679931 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2121c5-1db0-4977-b770-712754b50086 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:46.680298 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2121c5-1db0-4977-b770-712754b50086 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:46.680650 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2121c5-1db0-4977-b770-712754b50086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:46.683173 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00145dcb-0aeb-4564-906f-31f465c1a342 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:46.700460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 211/423] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:46.709734 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00145dcb-0aeb-4564-906f-31f465c1a342 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:46.773159 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:46.817601 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2121c5-1db0-4977-b770-712754b50086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:46.820417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2121c5-1db0-4977-b770-712754b50086 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:46.925059 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00145dcb-0aeb-4564-906f-31f465c1a342 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:46.988419 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6042c-da57-4f76-93ba-a73201feb8f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:46.990039 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6042c-da57-4f76-93ba-a73201feb8f2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:46.990653 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6042c-da57-4f76-93ba-a73201feb8f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:46.991407 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6042c-da57-4f76-93ba-a73201feb8f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:47.055364 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:47.146944 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 213/424] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 647 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:47.147868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6042c-da57-4f76-93ba-a73201feb8f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:47.149462 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6042c-da57-4f76-93ba-a73201feb8f2 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:47.159239 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2121c5-1db0-4977-b770-712754b50086 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:47.331136 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:47.340672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2121c5-1db0-4977-b770-712754b50086 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:47.379539 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 212/425] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 07:56:47.386544 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6042c-da57-4f76-93ba-a73201feb8f2 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:47.408629 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ba027-6c45-44a2-8ea5-c28b3e85eb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:47.409612 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ba027-6c45-44a2-8ea5-c28b3e85eb64 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:47.409892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ba027-6c45-44a2-8ea5-c28b3e85eb64 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:47.410168 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875ba027-6c45-44a2-8ea5-c28b3e85eb64 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:47.411576 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ba027-6c45-44a2-8ea5-c28b3e85eb64 None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:47.414261 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875ba027-6c45-44a2-8ea5-c28b3e85eb64 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:47.416181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 214/426] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:47 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:47.431891 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ba027-6c45-44a2-8ea5-c28b3e85eb64 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:47.536138 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:47.654047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875ba027-6c45-44a2-8ea5-c28b3e85eb64 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:47.666487 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6042c-da57-4f76-93ba-a73201feb8f2 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:47.735050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa2d26-73dd-4c03-9e68-8b9268916daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:47.736907 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2d26-73dd-4c03-9e68-8b9268916daa None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:47.737429 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2d26-73dd-4c03-9e68-8b9268916daa None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:47.737952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35aa2d26-73dd-4c03-9e68-8b9268916daa None admin] PATH_INFO: `/v3/groups/560aedcb8cb04a478692dc0a19a527e9` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:47.744153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa2d26-73dd-4c03-9e68-8b9268916daa None admin] RBAC: Authorizing `identity:get_group(group_id=560aedcb8cb04a478692dc0a19a527e9)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:47.744153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35aa2d26-73dd-4c03-9e68-8b9268916daa None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:47.748182 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 215/427] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:47 2022] GET /identity/v3/groups/560aedcb8cb04a478692dc0a19a527e9 => generated 226 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:47.765192 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa2d26-73dd-4c03-9e68-8b9268916daa None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:47.808992 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9628-bb0c-4106-bea5-5f8a0ffe9a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:47.809888 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9628-bb0c-4106-bea5-5f8a0ffe9a32 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:47.810179 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9628-bb0c-4106-bea5-5f8a0ffe9a32 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:47.810457 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eac9628-bb0c-4106-bea5-5f8a0ffe9a32 None admin] PATH_INFO: `/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:47.817145 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac9628-bb0c-4106-bea5-5f8a0ffe9a32 None admin] RBAC: Authorizing `identity:get_project(project_id=b49bdd94998e4f67af5ef2d3eb963c3b)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:47.818652 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eac9628-bb0c-4106-bea5-5f8a0ffe9a32 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:47.820815 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 213/428] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:47 2022] GET /identity/v3/projects/b49bdd94998e4f67af5ef2d3eb963c3b => generated 298 bytes in 435 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:47.829252 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9628-bb0c-4106-bea5-5f8a0ffe9a32 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:47.837391 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:48.003223 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35aa2d26-73dd-4c03-9e68-8b9268916daa None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:48.080768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5a3e8-3893-498f-9d9b-47aa855fba51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:48.081438 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5a3e8-3893-498f-9d9b-47aa855fba51 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:48.081726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5a3e8-3893-498f-9d9b-47aa855fba51 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:48.082005 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5a3e8-3893-498f-9d9b-47aa855fba51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:48.082850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5a3e8-3893-498f-9d9b-47aa855fba51 None admin] RBAC: Adding query filter params (group.id=560aedcb8cb04a478692dc0a19a527e9, role.id=fb458495153d4239becfaff1b68b012e, scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:48.083164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5a3e8-3893-498f-9d9b-47aa855fba51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:48.084703 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5a3e8-3893-498f-9d9b-47aa855fba51 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:48.092794 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 216/429] 10.222.0.25 () {56 vars in 1376 bytes} [Wed May 25 07:56:47 2022] GET /identity/v3/role_assignments?group.id=560aedcb8cb04a478692dc0a19a527e9&scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b&role.id=fb458495153d4239becfaff1b68b012e => generated 611 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:48.094310 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55392d-d03b-4750-ba92-fbc4c0b689f2 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:48.094606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55392d-d03b-4750-ba92-fbc4c0b689f2 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:48.094847 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55392d-d03b-4750-ba92-fbc4c0b689f2 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:48.096471 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 217/430] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:48.101956 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f7c4-115c-4728-adad-35999a4a75b5 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:48.102387 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f7c4-115c-4728-adad-35999a4a75b5 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:48.102766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805f7c4-115c-4728-adad-35999a4a75b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:48.122432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-e805f7c4-115c-4728-adad-35999a4a75b5 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:48.123804 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-e805f7c4-115c-4728-adad-35999a4a75b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:48.126916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eac9628-bb0c-4106-bea5-5f8a0ffe9a32 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:48.193330 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:48.220060 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229118ad-b1ba-4b9d-b417-e95bd555211e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:48.220989 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229118ad-b1ba-4b9d-b417-e95bd555211e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:48.221377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229118ad-b1ba-4b9d-b417-e95bd555211e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:48.221611 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229118ad-b1ba-4b9d-b417-e95bd555211e None admin] PATH_INFO: `/v3/groups/560aedcb8cb04a478692dc0a19a527e9` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:48.228284 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229118ad-b1ba-4b9d-b417-e95bd555211e None admin] RBAC: Authorizing `identity:get_group(group_id=560aedcb8cb04a478692dc0a19a527e9)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:48.229887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229118ad-b1ba-4b9d-b417-e95bd555211e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:48.237311 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 214/431] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:47 2022] GET /identity/v3/groups/560aedcb8cb04a478692dc0a19a527e9 => generated 226 bytes in 408 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:48.238296 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229118ad-b1ba-4b9d-b417-e95bd555211e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:48.299008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 218/432] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:48.324740 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805f7c4-115c-4728-adad-35999a4a75b5 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:48.378811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:48.455271 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229118ad-b1ba-4b9d-b417-e95bd555211e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:48.490480 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805f7c4-115c-4728-adad-35999a4a75b5 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:48.500744 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6836cbaa-239c-45d5-8a70-cf1e7661f00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:48.501416 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836cbaa-239c-45d5-8a70-cf1e7661f00f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:48.501696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836cbaa-239c-45d5-8a70-cf1e7661f00f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:48.502148 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6836cbaa-239c-45d5-8a70-cf1e7661f00f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:48.503216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836cbaa-239c-45d5-8a70-cf1e7661f00f None admin] RBAC: Adding query filter params (group.id=560aedcb8cb04a478692dc0a19a527e9, role.id=0e5f3c37f30e45da98262a20b891833d, scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:48.503742 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836cbaa-239c-45d5-8a70-cf1e7661f00f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:48.505767 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6836cbaa-239c-45d5-8a70-cf1e7661f00f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:48.513378 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 215/433] 10.222.0.25 () {56 vars in 1376 bytes} [Wed May 25 07:56:48 2022] GET /identity/v3/role_assignments?group.id=560aedcb8cb04a478692dc0a19a527e9&scope.project.id=b49bdd94998e4f67af5ef2d3eb963c3b&role.id=0e5f3c37f30e45da98262a20b891833d => generated 611 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:48.515206 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a7d59-e036-4c9a-b7c6-6c5c4942ac94 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:48.516042 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a7d59-e036-4c9a-b7c6-6c5c4942ac94 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:48.516563 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10a7d59-e036-4c9a-b7c6-6c5c4942ac94 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:48.520207 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 216/434] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:48.524519 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8070a4c-42ec-4481-b847-8e551ff9ded0 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:48.525078 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8070a4c-42ec-4481-b847-8e551ff9ded0 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:48.525517 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8070a4c-42ec-4481-b847-8e551ff9ded0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:48.541908 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233611c-8a21-4ae4-9fd3-1c71884237f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:48.543559 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233611c-8a21-4ae4-9fd3-1c71884237f0 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:48.543939 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233611c-8a21-4ae4-9fd3-1c71884237f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:48.544371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9233611c-8a21-4ae4-9fd3-1c71884237f0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:48.547504 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-b8070a4c-42ec-4481-b847-8e551ff9ded0 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:48.549124 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-b8070a4c-42ec-4481-b847-8e551ff9ded0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:48.564360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9233611c-8a21-4ae4-9fd3-1c71884237f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-9233611c-8a21-4ae4-9fd3-1c71884237f0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:48.575318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:48.576501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:48.577360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:48.577360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:48.577360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:48.577360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:48.577360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:48.577360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:48.577360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:48.577360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:48.577360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:48.577360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:48.577360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 25 07:56:48.577360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:48.577360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 219/435] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:56:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:56:48.584871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233611c-8a21-4ae4-9fd3-1c71884237f0 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:48.667495 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:48.714168 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 217/436] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:56:48.736749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8070a4c-42ec-4481-b847-8e551ff9ded0 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:48.742633 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:48.766550 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9233611c-8a21-4ae4-9fd3-1c71884237f0 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:48.809870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3c375-ccc9-43b4-abeb-4dda2239dd90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:48.810622 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3c375-ccc9-43b4-abeb-4dda2239dd90 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:48.810812 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3c375-ccc9-43b4-abeb-4dda2239dd90 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:48.811044 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b3c375-ccc9-43b4-abeb-4dda2239dd90 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:48.811836 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3c375-ccc9-43b4-abeb-4dda2239dd90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:48.812177 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3c375-ccc9-43b4-abeb-4dda2239dd90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:48.814676 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b3c375-ccc9-43b4-abeb-4dda2239dd90 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:48.828179 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 220/437] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:56:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:48.836954 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3c375-ccc9-43b4-abeb-4dda2239dd90 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:48.912819 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8070a4c-42ec-4481-b847-8e551ff9ded0 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:48.969954 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534dee3-fef3-4336-98c4-be8e8f9147cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:48.970796 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534dee3-fef3-4336-98c4-be8e8f9147cd None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:48.971080 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534dee3-fef3-4336-98c4-be8e8f9147cd None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:48.971648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534dee3-fef3-4336-98c4-be8e8f9147cd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:48.989997 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534dee3-fef3-4336-98c4-be8e8f9147cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-a534dee3-fef3-4336-98c4-be8e8f9147cd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:49.003953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:49.005761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:49.007827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:49.007827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:49.007827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:49.007827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:49.007827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:49.007827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:49.007827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:49.007827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:49.007827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:49.007827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:49.007827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 25 07:56:49.007827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:49.007827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 218/438] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:49.015155 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534dee3-fef3-4336-98c4-be8e8f9147cd None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:49.021764 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b3c375-ccc9-43b4-abeb-4dda2239dd90 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:49.075568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7f647-4634-4af1-8882-039303a51eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:49.076663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7f647-4634-4af1-8882-039303a51eb3 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:49.077175 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7f647-4634-4af1-8882-039303a51eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:49.077646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb7f647-4634-4af1-8882-039303a51eb3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:49.099841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:49.115612 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:49.203184 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534dee3-fef3-4336-98c4-be8e8f9147cd None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:49.247976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7f647-4634-4af1-8882-039303a51eb3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:49.251560 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb7f647-4634-4af1-8882-039303a51eb3 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:49.279796 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c87c5b-b921-4dd1-9609-912e90b28810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:49.281055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c87c5b-b921-4dd1-9609-912e90b28810 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:49.283000 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c87c5b-b921-4dd1-9609-912e90b28810 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:49.283571 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c87c5b-b921-4dd1-9609-912e90b28810 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:49.285262 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c87c5b-b921-4dd1-9609-912e90b28810 None admin] RBAC: Adding query filter params (name=member) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:49.285808 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c87c5b-b921-4dd1-9609-912e90b28810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:49.288161 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c87c5b-b921-4dd1-9609-912e90b28810 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:49.306846 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 219/439] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:56:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:49.314648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c87c5b-b921-4dd1-9609-912e90b28810 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:49.429047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 221/440] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:49.439257 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7f647-4634-4af1-8882-039303a51eb3 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:49.472490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c87c5b-b921-4dd1-9609-912e90b28810 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:49.487235 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:49.515952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:49.517199 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe897d9f-6b65-4659-bdc9-e2576d73d01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:49.517857 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe897d9f-6b65-4659-bdc9-e2576d73d01b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:49.518136 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe897d9f-6b65-4659-bdc9-e2576d73d01b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:49.518426 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe897d9f-6b65-4659-bdc9-e2576d73d01b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:49.570840 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb7f647-4634-4af1-8882-039303a51eb3 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:49.600132 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe897d9f-6b65-4659-bdc9-e2576d73d01b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:49.601632 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe897d9f-6b65-4659-bdc9-e2576d73d01b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:49.609113 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380f8deb-3029-4433-97de-8259734fbdeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:49.609989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f8deb-3029-4433-97de-8259734fbdeb None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:49.610278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f8deb-3029-4433-97de-8259734fbdeb None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:49.610568 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380f8deb-3029-4433-97de-8259734fbdeb None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:49.611824 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f8deb-3029-4433-97de-8259734fbdeb None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:49.613330 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380f8deb-3029-4433-97de-8259734fbdeb None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:49.615050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 222/441] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:49 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:49.616319 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd904-d561-4063-b003-c257ac4da34d None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:49.616612 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd904-d561-4063-b003-c257ac4da34d None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:49.616896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781cd904-d561-4063-b003-c257ac4da34d None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:49.618170 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 223/442] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:49.624904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37201001-3232-4e79-a3fa-78bea5ee659c None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:49.625193 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37201001-3232-4e79-a3fa-78bea5ee659c None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:49.625500 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37201001-3232-4e79-a3fa-78bea5ee659c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:49.643694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-37201001-3232-4e79-a3fa-78bea5ee659c None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:49.644949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-37201001-3232-4e79-a3fa-78bea5ee659c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:49.727930 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 224/443] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:56:49.735425 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37201001-3232-4e79-a3fa-78bea5ee659c None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:49.735632 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 220/444] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 25 07:56:49.738583 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe897d9f-6b65-4659-bdc9-e2576d73d01b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:49.761891 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:49.794641 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:49.873313 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe897d9f-6b65-4659-bdc9-e2576d73d01b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:49.883206 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37201001-3232-4e79-a3fa-78bea5ee659c None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:49.911368 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9e422-98f8-4d6f-a3f8-64c9cf5cfdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:49.912304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9e422-98f8-4d6f-a3f8-64c9cf5cfdd2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:49.912591 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9e422-98f8-4d6f-a3f8-64c9cf5cfdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:49.912865 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9e422-98f8-4d6f-a3f8-64c9cf5cfdd2 None admin] PATH_INFO: `/v3/projects/6d09612017fd488a94e457afdcdec8a7` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:49.914096 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9e422-98f8-4d6f-a3f8-64c9cf5cfdd2 None admin] RBAC: Authorizing `identity:get_project(project_id=6d09612017fd488a94e457afdcdec8a7)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:49.915552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9e422-98f8-4d6f-a3f8-64c9cf5cfdd2 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:49.917889 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 221/445] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:49 2022] GET /identity/v3/projects/6d09612017fd488a94e457afdcdec8a7 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:49.923376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9e422-98f8-4d6f-a3f8-64c9cf5cfdd2 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:49.930217 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0243b-24e3-45ab-b323-d1cac2324c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:49.931109 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0243b-24e3-45ab-b323-d1cac2324c00 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:49.931393 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0243b-24e3-45ab-b323-d1cac2324c00 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:49.931673 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab0243b-24e3-45ab-b323-d1cac2324c00 None admin] PATH_INFO: `/v3/groups/560aedcb8cb04a478692dc0a19a527e9` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:49.933000 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0243b-24e3-45ab-b323-d1cac2324c00 None admin] RBAC: Authorizing `identity:get_group(group_id=560aedcb8cb04a478692dc0a19a527e9)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:49.934480 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab0243b-24e3-45ab-b323-d1cac2324c00 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:49.936184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 225/446] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:49 2022] GET /identity/v3/groups/560aedcb8cb04a478692dc0a19a527e9 => generated 226 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:49.936983 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0243b-24e3-45ab-b323-d1cac2324c00 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:50.026030 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:50.051341 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9e422-98f8-4d6f-a3f8-64c9cf5cfdd2 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:50.055309 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab0243b-24e3-45ab-b323-d1cac2324c00 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:50.070505 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:50.090524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a20192-7394-4348-8c9d-51a1c31590f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:50.091337 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20192-7394-4348-8c9d-51a1c31590f5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:50.091621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20192-7394-4348-8c9d-51a1c31590f5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:50.091895 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a20192-7394-4348-8c9d-51a1c31590f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:50.102662 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76258c4f-d92f-4650-8a7b-c29bb28a33d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:50.103485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a20192-7394-4348-8c9d-51a1c31590f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:50.103613 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76258c4f-d92f-4650-8a7b-c29bb28a33d9 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:50.103823 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76258c4f-d92f-4650-8a7b-c29bb28a33d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:50.104109 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76258c4f-d92f-4650-8a7b-c29bb28a33d9 None admin] PATH_INFO: `/v3/groups/560aedcb8cb04a478692dc0a19a527e9` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:50.105995 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76258c4f-d92f-4650-8a7b-c29bb28a33d9 None admin] RBAC: Authorizing `identity:get_group(group_id=560aedcb8cb04a478692dc0a19a527e9)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:50.107451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76258c4f-d92f-4650-8a7b-c29bb28a33d9 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:50.109161 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 226/447] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:49 2022] GET /identity/v3/groups/560aedcb8cb04a478692dc0a19a527e9 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:50.109967 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76258c4f-d92f-4650-8a7b-c29bb28a33d9 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-d9a20192-7394-4348-8c9d-51a1c31590f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:50.111864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:50.113511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:50.115055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:50.115055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:50.115055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:50.115055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:50.115055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:50.115055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:50.115055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:50.115055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:50.115055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:50.115055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:50.115055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:56:50.115055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:50.115055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 222/448] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:56:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:50.119476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a20192-7394-4348-8c9d-51a1c31590f5 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:50.231631 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76258c4f-d92f-4650-8a7b-c29bb28a33d9 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:50.234892 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a20192-7394-4348-8c9d-51a1c31590f5 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:50.271619 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4848-5f6b-49f2-9de7-195682363a66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:50.272322 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4848-5f6b-49f2-9de7-195682363a66 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:50.272441 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b2672-9d57-45be-91d0-ac6af7cf336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:50.272617 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4848-5f6b-49f2-9de7-195682363a66 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:50.272913 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd4848-5f6b-49f2-9de7-195682363a66 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:50.273087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b2672-9d57-45be-91d0-ac6af7cf336d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:50.273332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b2672-9d57-45be-91d0-ac6af7cf336d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:50.273617 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1b2672-9d57-45be-91d0-ac6af7cf336d None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:50.273749 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd4848-5f6b-49f2-9de7-195682363a66 None admin] RBAC: Adding query filter params (group.id=560aedcb8cb04a478692dc0a19a527e9, role.id=fb458495153d4239becfaff1b68b012e, scope.project.id=6d09612017fd488a94e457afdcdec8a7) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:50.274013 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd4848-5f6b-49f2-9de7-195682363a66 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:50.274369 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b2672-9d57-45be-91d0-ac6af7cf336d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:50.274682 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b2672-9d57-45be-91d0-ac6af7cf336d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:50.275470 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fd4848-5f6b-49f2-9de7-195682363a66 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:50.276176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1b2672-9d57-45be-91d0-ac6af7cf336d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:50.282748 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 227/449] 10.222.0.25 () {56 vars in 1376 bytes} [Wed May 25 07:56:50 2022] GET /identity/v3/role_assignments?group.id=560aedcb8cb04a478692dc0a19a527e9&scope.project.id=6d09612017fd488a94e457afdcdec8a7&role.id=fb458495153d4239becfaff1b68b012e => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:50.283600 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4848-5f6b-49f2-9de7-195682363a66 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:50.284526 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:50.300875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 223/450] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:50.309335 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b2672-9d57-45be-91d0-ac6af7cf336d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:50.350676 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:50.433527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd4848-5f6b-49f2-9de7-195682363a66 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:50.470124 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1b2672-9d57-45be-91d0-ac6af7cf336d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:50.497803 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecc810-88b5-4871-bfd4-f00b630a6a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:50.498714 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecc810-88b5-4871-bfd4-f00b630a6a2c None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:50.499009 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecc810-88b5-4871-bfd4-f00b630a6a2c None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:50.500022 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbecc810-88b5-4871-bfd4-f00b630a6a2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:50.500736 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecc810-88b5-4871-bfd4-f00b630a6a2c None admin] RBAC: Adding query filter params (group.id=560aedcb8cb04a478692dc0a19a527e9, role.id=0e5f3c37f30e45da98262a20b891833d, scope.project.id=6d09612017fd488a94e457afdcdec8a7) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:50.501289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecc810-88b5-4871-bfd4-f00b630a6a2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:50.503213 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbecc810-88b5-4871-bfd4-f00b630a6a2c None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:50.512003 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 228/451] 10.222.0.25 () {56 vars in 1376 bytes} [Wed May 25 07:56:50 2022] GET /identity/v3/role_assignments?group.id=560aedcb8cb04a478692dc0a19a527e9&scope.project.id=6d09612017fd488a94e457afdcdec8a7&role.id=0e5f3c37f30e45da98262a20b891833d => generated 611 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:50.519094 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525828f-7d45-494d-a9e7-28beae3920d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:50.519980 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525828f-7d45-494d-a9e7-28beae3920d7 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:50.521183 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525828f-7d45-494d-a9e7-28beae3920d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:50.521183 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525828f-7d45-494d-a9e7-28beae3920d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:50.623454 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:50.626313 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525828f-7d45-494d-a9e7-28beae3920d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:50.628282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525828f-7d45-494d-a9e7-28beae3920d7 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:50.751576 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 224/452] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:56:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:56:50.757332 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecc810-88b5-4871-bfd4-f00b630a6a2c None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:50.903701 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbecc810-88b5-4871-bfd4-f00b630a6a2c None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:50.917029 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:50.953030 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e996e-5560-4907-844b-a44d0cfca0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:50.953940 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e996e-5560-4907-844b-a44d0cfca0fb None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:50.954227 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e996e-5560-4907-844b-a44d0cfca0fb None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:50.954507 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e996e-5560-4907-844b-a44d0cfca0fb None admin] PATH_INFO: `/v3/projects/93a049a9852946a29f77e99f63516cc1` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:50.955930 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e996e-5560-4907-844b-a44d0cfca0fb None admin] RBAC: Authorizing `identity:get_project(project_id=93a049a9852946a29f77e99f63516cc1)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:50.957567 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e996e-5560-4907-844b-a44d0cfca0fb None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:50.959509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 229/453] 10.222.0.25 () {56 vars in 1186 bytes} [Wed May 25 07:56:50 2022] GET /identity/v3/projects/93a049a9852946a29f77e99f63516cc1 => generated 344 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:50.967331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525828f-7d45-494d-a9e7-28beae3920d7 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:51.087464 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:51.093106 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525828f-7d45-494d-a9e7-28beae3920d7 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:51.135496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42f6000-b9c0-4e7f-a3b1-48273497c719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:51.136312 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f6000-b9c0-4e7f-a3b1-48273497c719 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:51.136602 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f6000-b9c0-4e7f-a3b1-48273497c719 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:51.136885 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42f6000-b9c0-4e7f-a3b1-48273497c719 None admin] PATH_INFO: `/v3/groups/346d50c109b54581b80e3811277cd3d8` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:51.138083 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f6000-b9c0-4e7f-a3b1-48273497c719 None admin] RBAC: Authorizing `identity:get_group(group_id=346d50c109b54581b80e3811277cd3d8)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:51.139626 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42f6000-b9c0-4e7f-a3b1-48273497c719 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:51.141557 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 225/454] 10.222.0.25 () {56 vars in 1180 bytes} [Wed May 25 07:56:50 2022] GET /identity/v3/groups/346d50c109b54581b80e3811277cd3d8 => generated 229 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:51.147451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e996e-5560-4907-844b-a44d0cfca0fb None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:51.253595 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e996e-5560-4907-844b-a44d0cfca0fb None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:51.286952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb86b92d-dd7e-46bc-9145-6a91ba9214fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:51.287600 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86b92d-dd7e-46bc-9145-6a91ba9214fb None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:51.287883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86b92d-dd7e-46bc-9145-6a91ba9214fb None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:51.288185 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb86b92d-dd7e-46bc-9145-6a91ba9214fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:51.289010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86b92d-dd7e-46bc-9145-6a91ba9214fb None admin] RBAC: Adding query filter params (group.id=346d50c109b54581b80e3811277cd3d8, role.id=5c1382efdc2e4eebaf5f15a4cdae58e0, scope.project.id=93a049a9852946a29f77e99f63516cc1) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:51.289319 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86b92d-dd7e-46bc-9145-6a91ba9214fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:51.290765 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb86b92d-dd7e-46bc-9145-6a91ba9214fb None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:51.296761 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 230/455] 10.222.0.25 () {56 vars in 1376 bytes} [Wed May 25 07:56:51 2022] GET /identity/v3/role_assignments?group.id=346d50c109b54581b80e3811277cd3d8&scope.project.id=93a049a9852946a29f77e99f63516cc1&role.id=5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:54.631305 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d0406-3dcc-4d12-b70b-679c4790b8eb None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:54.631305 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d0406-3dcc-4d12-b70b-679c4790b8eb None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:54.631305 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d0406-3dcc-4d12-b70b-679c4790b8eb None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:54.632404 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 226/456] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:56:54.639295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bf427-2c7c-4242-89d7-6cfc1b5d21aa None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:54.640320 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bf427-2c7c-4242-89d7-6cfc1b5d21aa None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:54.641164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65bf427-2c7c-4242-89d7-6cfc1b5d21aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:54.660801 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-a65bf427-2c7c-4242-89d7-6cfc1b5d21aa None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:54.662456 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-a65bf427-2c7c-4242-89d7-6cfc1b5d21aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:54.703167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:54.744270 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 231/457] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:56:54.765924 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d0406-3dcc-4d12-b70b-679c4790b8eb None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:54.886225 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d0406-3dcc-4d12-b70b-679c4790b8eb None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:54.924401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aca4eb-d5ff-42e3-a84b-43272f3b852b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:54.925203 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aca4eb-d5ff-42e3-a84b-43272f3b852b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:54.925475 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aca4eb-d5ff-42e3-a84b-43272f3b852b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:54.925913 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aca4eb-d5ff-42e3-a84b-43272f3b852b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:54.937865 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aca4eb-d5ff-42e3-a84b-43272f3b852b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:54.939622 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aca4eb-d5ff-42e3-a84b-43272f3b852b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-89aca4eb-d5ff-42e3-a84b-43272f3b852b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:56:54.960916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:54.961918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:54.962878 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:56:54.962878 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:56:54.962878 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:56:54.962878 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:54.971681 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 227/458] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:56:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:54.973435 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bf427-2c7c-4242-89d7-6cfc1b5d21aa None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:55.091135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65bf427-2c7c-4242-89d7-6cfc1b5d21aa None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:55.129301 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb9a5bb-73ac-46d0-ac4e-47571706cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:55.130232 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a5bb-73ac-46d0-ac4e-47571706cfde None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:55.130659 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a5bb-73ac-46d0-ac4e-47571706cfde None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:55.131109 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb9a5bb-73ac-46d0-ac4e-47571706cfde None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:55.132003 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9a5bb-73ac-46d0-ac4e-47571706cfde None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:55.132495 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9a5bb-73ac-46d0-ac4e-47571706cfde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:55.134053 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb9a5bb-73ac-46d0-ac4e-47571706cfde None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:55.152459 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 232/459] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:56:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:55.154978 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aca4eb-d5ff-42e3-a84b-43272f3b852b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:55.184330 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:55.217185 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775017-fc31-44d3-8b64-32d8d1ea99a5 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:55.218360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775017-fc31-44d3-8b64-32d8d1ea99a5 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:55.218827 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4775017-fc31-44d3-8b64-32d8d1ea99a5 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:55.221577 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 233/460] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:56:55.228575 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c275cc9-c67c-47fd-a7d4-8b79f6cc7fbe None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:55.229482 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c275cc9-c67c-47fd-a7d4-8b79f6cc7fbe None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:55.229987 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c275cc9-c67c-47fd-a7d4-8b79f6cc7fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:55.252020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-9c275cc9-c67c-47fd-a7d4-8b79f6cc7fbe None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:55.253820 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-9c275cc9-c67c-47fd-a7d4-8b79f6cc7fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:55.292155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:55.301997 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aca4eb-d5ff-42e3-a84b-43272f3b852b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:55.360634 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 234/461] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:55.367304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79072ba-6a9d-4042-a6be-4fa2a2a92fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:55.369202 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79072ba-6a9d-4042-a6be-4fa2a2a92fa7 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:55.370135 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79072ba-6a9d-4042-a6be-4fa2a2a92fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:55.371417 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79072ba-6a9d-4042-a6be-4fa2a2a92fa7 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:55.373172 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79072ba-6a9d-4042-a6be-4fa2a2a92fa7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:55.376289 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79072ba-6a9d-4042-a6be-4fa2a2a92fa7 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:55.394584 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c275cc9-c67c-47fd-a7d4-8b79f6cc7fbe None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:55.418725 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 228/462] 10.222.0.25 () {60 vars in 1132 bytes} [Wed May 25 07:56:55 2022] POST /identity/v3/users => generated 248 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:56:55.557347 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c275cc9-c67c-47fd-a7d4-8b79f6cc7fbe None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:55.619626 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b02aeb-ec89-449b-b856-8eb5d0d2281e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:55.621085 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b02aeb-ec89-449b-b856-8eb5d0d2281e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:55.621370 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b02aeb-ec89-449b-b856-8eb5d0d2281e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:55.621653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b02aeb-ec89-449b-b856-8eb5d0d2281e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:55.635342 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b02aeb-ec89-449b-b856-8eb5d0d2281e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:55.636987 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b02aeb-ec89-449b-b856-8eb5d0d2281e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-e2b02aeb-ec89-449b-b856-8eb5d0d2281e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:56:55.658897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:55.661199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:55.663484 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:56:55.663484 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:56:55.663484 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:56:55.663484 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:55.663484 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 235/463] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:56:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:55.667462 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79072ba-6a9d-4042-a6be-4fa2a2a92fa7 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:55.836878 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:55.843916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a21ded-8f6c-4fea-8ed1-ca1ebf248d35 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:55.844592 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a21ded-8f6c-4fea-8ed1-ca1ebf248d35 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:55.845114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a21ded-8f6c-4fea-8ed1-ca1ebf248d35 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:55.848381 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 236/464] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:55.853487 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaaa1c-7bee-4b14-8cfc-62b55c5e51d6 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:55.854137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaaa1c-7bee-4b14-8cfc-62b55c5e51d6 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:55.855180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfaaa1c-7bee-4b14-8cfc-62b55c5e51d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:55.875935 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-7dfaaa1c-7bee-4b14-8cfc-62b55c5e51d6 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:55.877739 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-7dfaaa1c-7bee-4b14-8cfc-62b55c5e51d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:55.883640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79072ba-6a9d-4042-a6be-4fa2a2a92fa7 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:55.891097 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:55.945627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466732b1-18f9-4614-9aa9-66f0adefd0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:55.946721 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466732b1-18f9-4614-9aa9-66f0adefd0b8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:55.947375 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466732b1-18f9-4614-9aa9-66f0adefd0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:55.948284 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-466732b1-18f9-4614-9aa9-66f0adefd0b8 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:55.949832 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466732b1-18f9-4614-9aa9-66f0adefd0b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:55.950568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466732b1-18f9-4614-9aa9-66f0adefd0b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:55.953539 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-466732b1-18f9-4614-9aa9-66f0adefd0b8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:55.995024 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 229/466] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:56:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:55.995322 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 237/466] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:56:55.997991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaaa1c-7bee-4b14-8cfc-62b55c5e51d6 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:56.017882 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466732b1-18f9-4614-9aa9-66f0adefd0b8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:56.129446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfaaa1c-7bee-4b14-8cfc-62b55c5e51d6 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:56.170506 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc31a5-0e3f-4c27-a648-10a923bc1c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:56.171472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc31a5-0e3f-4c27-a648-10a923bc1c4d None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:56.171911 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc31a5-0e3f-4c27-a648-10a923bc1c4d None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:56.172367 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc31a5-0e3f-4c27-a648-10a923bc1c4d None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:56.173237 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc31a5-0e3f-4c27-a648-10a923bc1c4d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:56.174898 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc31a5-0e3f-4c27-a648-10a923bc1c4d None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:56.195106 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:56.202000 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 238/467] 10.222.0.25 () {60 vars in 1132 bytes} [Wed May 25 07:56:55 2022] POST /identity/v3/users => generated 246 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:56:56.210988 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c17b39-efc5-4eec-abdd-db51c4d187ba None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:56.217105 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c17b39-efc5-4eec-abdd-db51c4d187ba None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:56.217105 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c17b39-efc5-4eec-abdd-db51c4d187ba None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:56.222256 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 239/468] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:56 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:56.224700 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031cf09-3328-4b61-b2ab-69ecf63eafba None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:56.225265 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031cf09-3328-4b61-b2ab-69ecf63eafba None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:56.225651 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5031cf09-3328-4b61-b2ab-69ecf63eafba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:56.252234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-466732b1-18f9-4614-9aa9-66f0adefd0b8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:56.262351 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-5031cf09-3328-4b61-b2ab-69ecf63eafba None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:56.264427 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-5031cf09-3328-4b61-b2ab-69ecf63eafba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:56.330149 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ddc6a-d5b7-4dda-8768-b07a6ebf6c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:56.331517 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ddc6a-d5b7-4dda-8768-b07a6ebf6c70 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:56.331968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ddc6a-d5b7-4dda-8768-b07a6ebf6c70 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:56.332469 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ddc6a-d5b7-4dda-8768-b07a6ebf6c70 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:56.353410 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ddc6a-d5b7-4dda-8768-b07a6ebf6c70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:56.356332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49ddc6a-d5b7-4dda-8768-b07a6ebf6c70 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:56.384733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-d49ddc6a-d5b7-4dda-8768-b07a6ebf6c70 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:56:56.393598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:56.394690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:56.395624 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:56:56.395624 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:56:56.395624 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:56:56.395624 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:56.397657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 230/469] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 381 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:56.405163 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ddc6a-d5b7-4dda-8768-b07a6ebf6c70 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:56.409406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 240/470] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:56.454675 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031cf09-3328-4b61-b2ab-69ecf63eafba None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:56.586487 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ddc6a-d5b7-4dda-8768-b07a6ebf6c70 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:56.655696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5031cf09-3328-4b61-b2ab-69ecf63eafba None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:56.664245 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45c1a8-6231-4260-9603-e17288291cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:56.664245 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45c1a8-6231-4260-9603-e17288291cba None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:56.664245 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45c1a8-6231-4260-9603-e17288291cba None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:56.664245 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad45c1a8-6231-4260-9603-e17288291cba None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:56.667483 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45c1a8-6231-4260-9603-e17288291cba None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:56.667483 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45c1a8-6231-4260-9603-e17288291cba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:56.668477 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad45c1a8-6231-4260-9603-e17288291cba None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:56.688932 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 231/471] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:56.696852 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45c1a8-6231-4260-9603-e17288291cba None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:56.715863 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:56.732906 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00ecac-f38a-419a-b836-e7a9e0d64d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:56.734979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00ecac-f38a-419a-b836-e7a9e0d64d81 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:56.735585 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00ecac-f38a-419a-b836-e7a9e0d64d81 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:56.736401 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00ecac-f38a-419a-b836-e7a9e0d64d81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:56.766503 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00ecac-f38a-419a-b836-e7a9e0d64d81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:56.770293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00ecac-f38a-419a-b836-e7a9e0d64d81 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:56.772896 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-fd00ecac-f38a-419a-b836-e7a9e0d64d81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:56:56.800915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:56.802598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:56.804324 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:56:56.804324 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:56:56.804324 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:56:56.804324 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:56:56.809851 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 241/472] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:56:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:56:56.809851 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00ecac-f38a-419a-b836-e7a9e0d64d81 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:56.912898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad45c1a8-6231-4260-9603-e17288291cba None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:56.931648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00ecac-f38a-419a-b836-e7a9e0d64d81 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:56.969356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee013c6d-ce34-414d-a37f-3028a10e8cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:56.970120 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee013c6d-ce34-414d-a37f-3028a10e8cc0 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:56.970363 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee013c6d-ce34-414d-a37f-3028a10e8cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:56.970624 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee013c6d-ce34-414d-a37f-3028a10e8cc0 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:56.971360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee013c6d-ce34-414d-a37f-3028a10e8cc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:56.971666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee013c6d-ce34-414d-a37f-3028a10e8cc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:56.973099 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee013c6d-ce34-414d-a37f-3028a10e8cc0 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:56.984634 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da79b1-2e47-4839-9298-e4f1199f732d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:56.986151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da79b1-2e47-4839-9298-e4f1199f732d None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:56.986830 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da79b1-2e47-4839-9298-e4f1199f732d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:56.987528 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da79b1-2e47-4839-9298-e4f1199f732d None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:56.989128 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da79b1-2e47-4839-9298-e4f1199f732d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:56.992088 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da79b1-2e47-4839-9298-e4f1199f732d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:56.992347 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 242/473] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:56:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:56:56.993633 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee013c6d-ce34-414d-a37f-3028a10e8cc0 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:57.034522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 232/474] 10.222.0.25 () {60 vars in 1132 bytes} [Wed May 25 07:56:56 2022] POST /identity/v3/users => generated 248 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:56:57.060035 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:57.190960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee013c6d-ce34-414d-a37f-3028a10e8cc0 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:57.237853 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4046cfa8-9a9d-4919-9b3e-11acf391107b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:57.238550 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046cfa8-9a9d-4919-9b3e-11acf391107b None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:57.238838 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046cfa8-9a9d-4919-9b3e-11acf391107b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:57.239109 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4046cfa8-9a9d-4919-9b3e-11acf391107b None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:57.239850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046cfa8-9a9d-4919-9b3e-11acf391107b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:57.243684 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4046cfa8-9a9d-4919-9b3e-11acf391107b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:57.284258 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 243/475] 10.222.0.25 () {60 vars in 1132 bytes} [Wed May 25 07:56:56 2022] POST /identity/v3/users => generated 249 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:56:58.530242 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c777a-0879-4ec0-85f5-e1089f38658d None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:58.530994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c777a-0879-4ec0-85f5-e1089f38658d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:58.530994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c777a-0879-4ec0-85f5-e1089f38658d None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:58.532514 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 233/476] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:58.538412 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096a32f-656b-4e16-b724-d3ccc5d246e1 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:58.539135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096a32f-656b-4e16-b724-d3ccc5d246e1 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:58.539135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d096a32f-656b-4e16-b724-d3ccc5d246e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:58.558506 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-d096a32f-656b-4e16-b724-d3ccc5d246e1 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:58.559725 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-d096a32f-656b-4e16-b724-d3ccc5d246e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:58.679281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 244/477] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:56:58.704614 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c777a-0879-4ec0-85f5-e1089f38658d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:58.907246 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c777a-0879-4ec0-85f5-e1089f38658d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:58.912928 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:58.973205 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282a15f-3181-43be-8227-3af224829338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:58.974542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282a15f-3181-43be-8227-3af224829338 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:58.975024 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282a15f-3181-43be-8227-3af224829338 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:58.975955 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b282a15f-3181-43be-8227-3af224829338 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:58.996110 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b282a15f-3181-43be-8227-3af224829338 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-b282a15f-3181-43be-8227-3af224829338 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:56:59.011635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:59.012671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:59.013453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:59.013453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:59.013453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:59.013453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:59.013453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:56:59.013453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:56:59.013453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:56:59.013453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:56:59.013453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:56:59.013453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:56:59.013453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:56:59.013453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:59.019108 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 234/478] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:56:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:56:59.020519 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096a32f-656b-4e16-b724-d3ccc5d246e1 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:59.053535 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:59.143899 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d096a32f-656b-4e16-b724-d3ccc5d246e1 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:59.184274 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077f226-87f4-4ef6-856a-5f5e70ea2ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:59.185329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f226-87f4-4ef6-856a-5f5e70ea2ba3 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:59.185826 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f226-87f4-4ef6-856a-5f5e70ea2ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:59.186295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f077f226-87f4-4ef6-856a-5f5e70ea2ba3 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:59.187287 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077f226-87f4-4ef6-856a-5f5e70ea2ba3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:59.187796 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077f226-87f4-4ef6-856a-5f5e70ea2ba3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:59.189501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f077f226-87f4-4ef6-856a-5f5e70ea2ba3 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:59.200378 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 245/479] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:56:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:59.207109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282a15f-3181-43be-8227-3af224829338 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:59.392392 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b282a15f-3181-43be-8227-3af224829338 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:59.461471 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91f363-8d0b-4dc5-aed3-3cfc81c18c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:59.462762 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91f363-8d0b-4dc5-aed3-3cfc81c18c65 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:59.463243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91f363-8d0b-4dc5-aed3-3cfc81c18c65 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:59.463763 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c91f363-8d0b-4dc5-aed3-3cfc81c18c65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:59.486428 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91f363-8d0b-4dc5-aed3-3cfc81c18c65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:59.489488 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c91f363-8d0b-4dc5-aed3-3cfc81c18c65 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-1c91f363-8d0b-4dc5-aed3-3cfc81c18c65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:56:59.525270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:56:59.526741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:56:59.527571 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:56:59.527571 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:56:59.527571 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:56:59.527571 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:56:59.529422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 235/480] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:56:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:56:59.534259 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077f226-87f4-4ef6-856a-5f5e70ea2ba3 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:59.681847 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:59.695806 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f077f226-87f4-4ef6-856a-5f5e70ea2ba3 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:59.749336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125121d8-13d7-49c7-8569-ea173c8fbf88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:59.750389 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125121d8-13d7-49c7-8569-ea173c8fbf88 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:59.750897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125121d8-13d7-49c7-8569-ea173c8fbf88 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:59.751405 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125121d8-13d7-49c7-8569-ea173c8fbf88 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:59.752782 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125121d8-13d7-49c7-8569-ea173c8fbf88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:56:59.753337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125121d8-13d7-49c7-8569-ea173c8fbf88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:59.755742 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125121d8-13d7-49c7-8569-ea173c8fbf88 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:56:59.779794 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 246/481] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:56:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:56:59.785253 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91f363-8d0b-4dc5-aed3-3cfc81c18c65 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:56:59.805587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:56:59.902315 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c4e34-4380-4623-80bb-2e28d6fcde8f None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:59.903049 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c4e34-4380-4623-80bb-2e28d6fcde8f None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:59.903613 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c4e34-4380-4623-80bb-2e28d6fcde8f None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:59.905831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 247/482] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:56:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:56:59.912397 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c91f363-8d0b-4dc5-aed3-3cfc81c18c65 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:56:59.916084 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471a0a8-6f21-4146-9f41-912fc474c512 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:59.917439 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471a0a8-6f21-4146-9f41-912fc474c512 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:59.917952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3471a0a8-6f21-4146-9f41-912fc474c512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:59.948821 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-3471a0a8-6f21-4146-9f41-912fc474c512 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:56:59.950893 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-3471a0a8-6f21-4146-9f41-912fc474c512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:56:59.964385 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c634ff7-b3c2-49ab-b81a-d201d68fb805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:56:59.965803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634ff7-b3c2-49ab-b81a-d201d68fb805 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:56:59.966311 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634ff7-b3c2-49ab-b81a-d201d68fb805 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:56:59.966812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c634ff7-b3c2-49ab-b81a-d201d68fb805 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:56:59.983114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c634ff7-b3c2-49ab-b81a-d201d68fb805 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:56:59.986064 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c634ff7-b3c2-49ab-b81a-d201d68fb805 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-2c634ff7-b3c2-49ab-b81a-d201d68fb805 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:00.005111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:00.007089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:00.009276 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:00.009276 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:00.009276 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:00.009276 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:00.009276 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:00.009276 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:00.009276 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:00.009276 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:00.009276 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 07:57:00.009276 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:00.014148 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 236/483] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:56:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:00.023593 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c634ff7-b3c2-49ab-b81a-d201d68fb805 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:00.093968 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 248/484] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:57:00.144166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471a0a8-6f21-4146-9f41-912fc474c512 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:00.163398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:00.213175 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c634ff7-b3c2-49ab-b81a-d201d68fb805 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:00.265108 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93901c41-8358-4cc0-9dfc-75c33661bb02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:00.266749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93901c41-8358-4cc0-9dfc-75c33661bb02 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:00.268875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93901c41-8358-4cc0-9dfc-75c33661bb02 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:00.269647 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93901c41-8358-4cc0-9dfc-75c33661bb02 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:00.270894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93901c41-8358-4cc0-9dfc-75c33661bb02 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:00.274047 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93901c41-8358-4cc0-9dfc-75c33661bb02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:00.275567 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93901c41-8358-4cc0-9dfc-75c33661bb02 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:00.329949 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 237/485] 10.222.0.25 () {56 vars in 1137 bytes} [Wed May 25 07:57:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:00.331001 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93901c41-8358-4cc0-9dfc-75c33661bb02 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:00.376024 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:00.457088 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3471a0a8-6f21-4146-9f41-912fc474c512 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:00.472963 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93901c41-8358-4cc0-9dfc-75c33661bb02 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:00.527382 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee599281-7c4e-441f-8497-e69d9c632ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:00.528307 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee599281-7c4e-441f-8497-e69d9c632ea4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:00.528768 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee599281-7c4e-441f-8497-e69d9c632ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:00.529149 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee599281-7c4e-441f-8497-e69d9c632ea4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:00.538126 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:00.571777 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43710d06-1c4b-4325-a6df-a596a51a4c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:00.573629 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43710d06-1c4b-4325-a6df-a596a51a4c65 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:00.574424 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43710d06-1c4b-4325-a6df-a596a51a4c65 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:00.577039 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43710d06-1c4b-4325-a6df-a596a51a4c65 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:00.598541 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43710d06-1c4b-4325-a6df-a596a51a4c65 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-43710d06-1c4b-4325-a6df-a596a51a4c65 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:00.609683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:00.611047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:00.612233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:00.612233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:00.612233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:00.612233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:00.612233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:00.612233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:00.612233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:00.612233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:00.612233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:00.612233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:00.612233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:00.612233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:00.612233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 249/486] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 469 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:00.613786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d34e92-b94f-409d-b748-41cfd5109b59 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:00.613786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d34e92-b94f-409d-b748-41cfd5109b59 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:00.613786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d34e92-b94f-409d-b748-41cfd5109b59 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:00.614922 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 250/487] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:00.616009 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614fc16-5ded-4ca5-a5e0-916bc00cf6b1 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:00.616317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614fc16-5ded-4ca5-a5e0-916bc00cf6b1 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:00.616590 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b614fc16-5ded-4ca5-a5e0-916bc00cf6b1 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:00.617948 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 251/488] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:00 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:00.622677 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614fc16-5ded-4ca5-a5e0-916bc00cf6b1 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:00.653406 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee599281-7c4e-441f-8497-e69d9c632ea4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:00.654904 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee599281-7c4e-441f-8497-e69d9c632ea4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:00.757997 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b614fc16-5ded-4ca5-a5e0-916bc00cf6b1 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:00.783048 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 238/489] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:57:00.784330 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761fbd1-b34d-4607-9263-7d3aa612c6b0 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:00.784620 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761fbd1-b34d-4607-9263-7d3aa612c6b0 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:00.784892 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8761fbd1-b34d-4607-9263-7d3aa612c6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:00.804327 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c644d676-92c2-47d6-bd7f-d49c55286508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:00.805034 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644d676-92c2-47d6-bd7f-d49c55286508 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:00.805320 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644d676-92c2-47d6-bd7f-d49c55286508 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:00.805599 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c644d676-92c2-47d6-bd7f-d49c55286508 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:00.806382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644d676-92c2-47d6-bd7f-d49c55286508 None admin] RBAC: Adding query filter params (name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:00.806694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644d676-92c2-47d6-bd7f-d49c55286508 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:00.806894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-8761fbd1-b34d-4607-9263-7d3aa612c6b0 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:00.808147 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c644d676-92c2-47d6-bd7f-d49c55286508 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:00.808247 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8761fbd1-b34d-4607-9263-7d3aa612c6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:00.817014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 252/490] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:57:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:00.820463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f39e0-bb5a-4a45-b90a-c28155d8e8ee None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:00.820984 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f39e0-bb5a-4a45-b90a-c28155d8e8ee None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:00.821782 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30f39e0-bb5a-4a45-b90a-c28155d8e8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:00.830412 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:00.845705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-f30f39e0-bb5a-4a45-b90a-c28155d8e8ee None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:00.845912 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:00.846993 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-f30f39e0-bb5a-4a45-b90a-c28155d8e8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:00.906331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 239/491] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:57:00.907959 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761fbd1-b34d-4607-9263-7d3aa612c6b0 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:00.932021 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 253/492] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:57:00.933931 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f39e0-bb5a-4a45-b90a-c28155d8e8ee None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:01.038284 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8761fbd1-b34d-4607-9263-7d3aa612c6b0 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:01.054433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30f39e0-bb5a-4a45-b90a-c28155d8e8ee None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:01.076715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2753b-bed9-47e6-b282-002e39a6dee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:01.077699 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2753b-bed9-47e6-b282-002e39a6dee3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:01.077984 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2753b-bed9-47e6-b282-002e39a6dee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:01.078271 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2753b-bed9-47e6-b282-002e39a6dee3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:01.089632 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2753b-bed9-47e6-b282-002e39a6dee3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:01.091133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2753b-bed9-47e6-b282-002e39a6dee3 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:01.096839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:01.102435 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca537ed-762b-4b72-a631-d478669ff183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:01.103242 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca537ed-762b-4b72-a631-d478669ff183 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:01.103596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca537ed-762b-4b72-a631-d478669ff183 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:01.103922 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca537ed-762b-4b72-a631-d478669ff183 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-1be2753b-bed9-47e6-b282-002e39a6dee3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:01.111902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:01.112874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:01.113733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:01.113733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:01.113733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:01.113733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:01.113733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 240/493] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:01.113999 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2753b-bed9-47e6-b282-002e39a6dee3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:01.124148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca537ed-762b-4b72-a631-d478669ff183 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:01.126067 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca537ed-762b-4b72-a631-d478669ff183 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:01.136849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-4ca537ed-762b-4b72-a631-d478669ff183 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:01.145127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:01.146745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:01.147618 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:01.147618 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:01.147618 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:01.147618 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:01.147618 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 254/494] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:01.147996 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca537ed-762b-4b72-a631-d478669ff183 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:01.237738 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2753b-bed9-47e6-b282-002e39a6dee3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:01.260875 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca537ed-762b-4b72-a631-d478669ff183 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:01.278428 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291c7f-622a-45f2-9887-df368f56a813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:01.279448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291c7f-622a-45f2-9887-df368f56a813 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:01.279738 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291c7f-622a-45f2-9887-df368f56a813 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:01.280019 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0291c7f-622a-45f2-9887-df368f56a813 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:01.290957 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0291c7f-622a-45f2-9887-df368f56a813 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-b0291c7f-622a-45f2-9887-df368f56a813 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:01.299401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:01.301238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 241/495] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:01.302055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291c7f-622a-45f2-9887-df368f56a813 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:01.312158 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba9bca-5169-483b-8a08-079a2364481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:01.313549 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba9bca-5169-483b-8a08-079a2364481e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:01.313982 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba9bca-5169-483b-8a08-079a2364481e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:01.314262 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba9bca-5169-483b-8a08-079a2364481e None admin] PATH_INFO: `/v3/roles/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:01.326915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba9bca-5169-483b-8a08-079a2364481e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-77ba9bca-5169-483b-8a08-079a2364481e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:01.334728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:01.336038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 255/496] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:01.337382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba9bca-5169-483b-8a08-079a2364481e None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:01.388367 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:01.395637 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:01.427100 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0291c7f-622a-45f2-9887-df368f56a813 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:01.454300 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba9bca-5169-483b-8a08-079a2364481e None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:01.467127 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fc3b8-5a11-43a2-9e0c-9e5d65b40660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:01.467717 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fc3b8-5a11-43a2-9e0c-9e5d65b40660 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:01.468173 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fc3b8-5a11-43a2-9e0c-9e5d65b40660 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:01.468320 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04fc3b8-5a11-43a2-9e0c-9e5d65b40660 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:01.469311 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fc3b8-5a11-43a2-9e0c-9e5d65b40660 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:01.469628 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fc3b8-5a11-43a2-9e0c-9e5d65b40660 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:01.471263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04fc3b8-5a11-43a2-9e0c-9e5d65b40660 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:01.488759 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 242/497] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:01.489871 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fc3b8-5a11-43a2-9e0c-9e5d65b40660 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:01.492989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aeff9-0524-4027-9888-316a1e5e5f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:01.493672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aeff9-0524-4027-9888-316a1e5e5f60 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:01.493965 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aeff9-0524-4027-9888-316a1e5e5f60 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:01.494229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76aeff9-0524-4027-9888-316a1e5e5f60 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:01.495535 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76aeff9-0524-4027-9888-316a1e5e5f60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:01.495843 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76aeff9-0524-4027-9888-316a1e5e5f60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:01.497291 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76aeff9-0524-4027-9888-316a1e5e5f60 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:01.510904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 256/498] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:01.511898 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aeff9-0524-4027-9888-316a1e5e5f60 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:01.606635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04fc3b8-5a11-43a2-9e0c-9e5d65b40660 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:01.618971 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76aeff9-0524-4027-9888-316a1e5e5f60 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:01.621949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:01.645213 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf756986-b9f9-4ad1-9bb5-79aef1158a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:01.645891 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf756986-b9f9-4ad1-9bb5-79aef1158a76 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:01.646176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf756986-b9f9-4ad1-9bb5-79aef1158a76 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:01.646457 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf756986-b9f9-4ad1-9bb5-79aef1158a76 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:01.647222 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf756986-b9f9-4ad1-9bb5-79aef1158a76 None admin] RBAC: Adding query filter params (name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:01.647550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf756986-b9f9-4ad1-9bb5-79aef1158a76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:01.648969 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf756986-b9f9-4ad1-9bb5-79aef1158a76 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:01.651516 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:01.659283 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 243/499] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:57:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:01.660150 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf756986-b9f9-4ad1-9bb5-79aef1158a76 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:01.664610 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91081275-568c-4277-9566-996f05df6967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:01.665214 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081275-568c-4277-9566-996f05df6967 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:01.665498 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081275-568c-4277-9566-996f05df6967 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:01.665775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91081275-568c-4277-9566-996f05df6967 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:01.666538 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91081275-568c-4277-9566-996f05df6967 None admin] RBAC: Adding query filter params (name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:01.667390 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91081275-568c-4277-9566-996f05df6967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:01.668835 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91081275-568c-4277-9566-996f05df6967 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:01.680313 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 257/500] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:57:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:01.681003 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91081275-568c-4277-9566-996f05df6967 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:01.786071 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf756986-b9f9-4ad1-9bb5-79aef1158a76 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:01.806358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91081275-568c-4277-9566-996f05df6967 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:01.835946 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9f740-75c6-462f-9bcd-fc3ee0725f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:01.836790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9f740-75c6-462f-9bcd-fc3ee0725f9b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:01.837076 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9f740-75c6-462f-9bcd-fc3ee0725f9b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:01.837664 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e9f740-75c6-462f-9bcd-fc3ee0725f9b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:01.843428 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7253d-d29f-4822-9a2b-fe81bd1b07ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:01.844253 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7253d-d29f-4822-9a2b-fe81bd1b07ed None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:01.844586 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7253d-d29f-4822-9a2b-fe81bd1b07ed None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:01.844835 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b7253d-d29f-4822-9a2b-fe81bd1b07ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:01.847314 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9f740-75c6-462f-9bcd-fc3ee0725f9b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:01.848866 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e9f740-75c6-462f-9bcd-fc3ee0725f9b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:01.853216 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7253d-d29f-4822-9a2b-fe81bd1b07ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:01.855255 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b7253d-d29f-4822-9a2b-fe81bd1b07ed None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-c0e9f740-75c6-462f-9bcd-fc3ee0725f9b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:01.865291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:01.866158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:01.867522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:01.867522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:01.867522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:01.867522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:01.867522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:01.867522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:01.867522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:01.867522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:01.867522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 244/501] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:01.867522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9f740-75c6-462f-9bcd-fc3ee0725f9b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-91b7253d-d29f-4822-9a2b-fe81bd1b07ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:01.871181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:01.873455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:01.877047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:01.877047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:01.877047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:01.877047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:01.877047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:01.877047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:01.877047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:01.877047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:01.877047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:57:01.877047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:01.877047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 258/502] 10.222.0.25 () {56 vars in 1093 bytes} [Wed May 25 07:57:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:01.877047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7253d-d29f-4822-9a2b-fe81bd1b07ed None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:01.906263 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:01.944177 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:01.988545 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b7253d-d29f-4822-9a2b-fe81bd1b07ed None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:01.992098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e9f740-75c6-462f-9bcd-fc3ee0725f9b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:02.028509 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47465007-ff73-4e77-ac73-9d9379f57924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:02.029330 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47465007-ff73-4e77-ac73-9d9379f57924 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:02.029611 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47465007-ff73-4e77-ac73-9d9379f57924 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:02.029893 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47465007-ff73-4e77-ac73-9d9379f57924 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:02.035102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1311c42-77e9-42d6-9f12-91ea3035769e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:02.036403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1311c42-77e9-42d6-9f12-91ea3035769e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:02.036832 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1311c42-77e9-42d6-9f12-91ea3035769e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:02.037341 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1311c42-77e9-42d6-9f12-91ea3035769e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:02.040582 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47465007-ff73-4e77-ac73-9d9379f57924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:02.047166 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47465007-ff73-4e77-ac73-9d9379f57924 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:02.054385 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1311c42-77e9-42d6-9f12-91ea3035769e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:02.055891 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1311c42-77e9-42d6-9f12-91ea3035769e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-47465007-ff73-4e77-ac73-9d9379f57924 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:02.061696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:02.062706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:02.063732 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:02.063732 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:02.063732 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:02.063732 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:02.063732 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 245/503] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:02.063732 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47465007-ff73-4e77-ac73-9d9379f57924 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-c1311c42-77e9-42d6-9f12-91ea3035769e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:02.077455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:02.078540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:02.079383 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:02.079383 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:02.079383 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:02.079383 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:02.079383 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 259/504] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:02.079978 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1311c42-77e9-42d6-9f12-91ea3035769e None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:02.193675 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:02.203347 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47465007-ff73-4e77-ac73-9d9379f57924 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:02.215370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:02.220552 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1311c42-77e9-42d6-9f12-91ea3035769e None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:02.240029 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c156b-3606-4bdc-9a6f-f1d544484dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:02.240725 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c156b-3606-4bdc-9a6f-f1d544484dc4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:02.241100 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c156b-3606-4bdc-9a6f-f1d544484dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:02.241308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2c156b-3606-4bdc-9a6f-f1d544484dc4 None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:02.242098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c156b-3606-4bdc-9a6f-f1d544484dc4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:02.242359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c156b-3606-4bdc-9a6f-f1d544484dc4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:02.243838 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2c156b-3606-4bdc-9a6f-f1d544484dc4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:02.261686 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3c687-9f5c-47b4-abd2-46837c378e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:02.261686 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3c687-9f5c-47b4-abd2-46837c378e13 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:02.261686 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3c687-9f5c-47b4-abd2-46837c378e13 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:02.261686 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a3c687-9f5c-47b4-abd2-46837c378e13 None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:02.262099 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3c687-9f5c-47b4-abd2-46837c378e13 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:02.262099 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3c687-9f5c-47b4-abd2-46837c378e13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:02.262886 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a3c687-9f5c-47b4-abd2-46837c378e13 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:02.265756 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 246/505] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:02.265756 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c156b-3606-4bdc-9a6f-f1d544484dc4 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:02.305887 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 260/506] 10.222.0.25 () {56 vars in 1133 bytes} [Wed May 25 07:57:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:02.308826 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3c687-9f5c-47b4-abd2-46837c378e13 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:02.381687 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2c156b-3606-4bdc-9a6f-f1d544484dc4 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:02.420625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a3c687-9f5c-47b4-abd2-46837c378e13 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:02.423236 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa066156-415f-4b39-9f39-2e744ddc61bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:02.424345 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa066156-415f-4b39-9f39-2e744ddc61bb None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:02.424717 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa066156-415f-4b39-9f39-2e744ddc61bb None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:02.425063 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa066156-415f-4b39-9f39-2e744ddc61bb None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:02.425876 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa066156-415f-4b39-9f39-2e744ddc61bb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:02.426249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa066156-415f-4b39-9f39-2e744ddc61bb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:02.427799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa066156-415f-4b39-9f39-2e744ddc61bb None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:02.440311 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 247/507] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:02.441181 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa066156-415f-4b39-9f39-2e744ddc61bb None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:02.464943 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d04460-e0da-4b1c-a74e-0ed575edaafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:02.466155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d04460-e0da-4b1c-a74e-0ed575edaafe None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:02.466155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d04460-e0da-4b1c-a74e-0ed575edaafe None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:02.466155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d04460-e0da-4b1c-a74e-0ed575edaafe None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:02.466809 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d04460-e0da-4b1c-a74e-0ed575edaafe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:02.467121 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d04460-e0da-4b1c-a74e-0ed575edaafe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:02.468584 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d04460-e0da-4b1c-a74e-0ed575edaafe None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:02.472283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:02.474420 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:02.482883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 261/508] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:02.483830 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d04460-e0da-4b1c-a74e-0ed575edaafe None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:02.552560 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa066156-415f-4b39-9f39-2e744ddc61bb None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:02.600392 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dc74a-93dc-4f55-932b-a8709d4e0aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:02.601053 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dc74a-93dc-4f55-932b-a8709d4e0aa1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:02.601336 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dc74a-93dc-4f55-932b-a8709d4e0aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:02.601614 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98dc74a-93dc-4f55-932b-a8709d4e0aa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:02.602460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98dc74a-93dc-4f55-932b-a8709d4e0aa1 None admin] RBAC: Adding query filter params (role.id=032121f695584aebbac76f0f8ca183fa, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=6ca17baadab7473c81d80597fc0fa0f2) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:02.602771 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98dc74a-93dc-4f55-932b-a8709d4e0aa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:02.604325 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98dc74a-93dc-4f55-932b-a8709d4e0aa1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:02.610335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d04460-e0da-4b1c-a74e-0ed575edaafe None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:02.610894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 248/509] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:57:02 2022] GET /identity/v3/role_assignments?user.id=6ca17baadab7473c81d80597fc0fa0f2&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=032121f695584aebbac76f0f8ca183fa => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:02.611714 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dc74a-93dc-4f55-932b-a8709d4e0aa1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:02.661081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba8891-3ba5-47dc-8bff-2b91871480ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:02.661769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba8891-3ba5-47dc-8bff-2b91871480ef None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:02.662053 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba8891-3ba5-47dc-8bff-2b91871480ef None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:02.662338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba8891-3ba5-47dc-8bff-2b91871480ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:02.759054 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:02.770220 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba8891-3ba5-47dc-8bff-2b91871480ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:02.772251 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba8891-3ba5-47dc-8bff-2b91871480ef None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:02.779318 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:02.792519 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98dc74a-93dc-4f55-932b-a8709d4e0aa1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:02.843295 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52012890-9480-4296-a50a-2dba1333a092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:02.844113 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52012890-9480-4296-a50a-2dba1333a092 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:02.844448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52012890-9480-4296-a50a-2dba1333a092 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:02.844725 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52012890-9480-4296-a50a-2dba1333a092 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:02.857255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52012890-9480-4296-a50a-2dba1333a092 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:02.859372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52012890-9480-4296-a50a-2dba1333a092 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-52012890-9480-4296-a50a-2dba1333a092 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:02.885160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:02.887310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:02.888783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:02.888783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:02.888783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:02.888783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:02.888783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:02.888783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:02.888783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:02.888783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:02.888783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:57:02.888783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:02.888783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 249/510] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:57:02 2022] GET /identity/v3/users/cinder => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:02.888783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52012890-9480-4296-a50a-2dba1333a092 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:02.921150 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 262/511] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:57:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:57:02.921930 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba8891-3ba5-47dc-8bff-2b91871480ef None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:03.033913 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52012890-9480-4296-a50a-2dba1333a092 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:03.081880 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:03.086861 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54163e5-e685-4308-ade0-760756b9b0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:03.087676 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54163e5-e685-4308-ade0-760756b9b0b8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:03.087961 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54163e5-e685-4308-ade0-760756b9b0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:03.088281 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54163e5-e685-4308-ade0-760756b9b0b8 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:03.093829 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba8891-3ba5-47dc-8bff-2b91871480ef None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:03.098344 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54163e5-e685-4308-ade0-760756b9b0b8 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:03.100828 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54163e5-e685-4308-ade0-760756b9b0b8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-d54163e5-e685-4308-ade0-760756b9b0b8 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:03.118542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:03.120824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:03.122531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:03.122531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:03.122531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:03.122531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:03.122531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:03.122531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:03.122531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:03.122531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:03.122531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 07:57:03.122531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:03.122531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 250/512] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:02 2022] GET /identity/v3/users/neutron => generated 85 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:03.122531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54163e5-e685-4308-ade0-760756b9b0b8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:03.147976 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:03.166074 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711f5e8-bf26-43f3-8234-b94845dc0c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:03.167786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f5e8-bf26-43f3-8234-b94845dc0c18 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:03.168319 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f5e8-bf26-43f3-8234-b94845dc0c18 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:03.168740 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0711f5e8-bf26-43f3-8234-b94845dc0c18 None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:03.170423 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711f5e8-bf26-43f3-8234-b94845dc0c18 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:03.170928 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711f5e8-bf26-43f3-8234-b94845dc0c18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:03.173445 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0711f5e8-bf26-43f3-8234-b94845dc0c18 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:03.211529 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 263/513] 10.222.0.25 () {56 vars in 1137 bytes} [Wed May 25 07:57:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:03.213327 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711f5e8-bf26-43f3-8234-b94845dc0c18 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:03.297135 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54163e5-e685-4308-ade0-760756b9b0b8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:03.341510 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26300f55-63be-4088-a18f-7ebed81d0820 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:03.342329 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26300f55-63be-4088-a18f-7ebed81d0820 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:03.342618 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26300f55-63be-4088-a18f-7ebed81d0820 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:03.342899 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26300f55-63be-4088-a18f-7ebed81d0820 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:03.358748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26300f55-63be-4088-a18f-7ebed81d0820 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:03.361381 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26300f55-63be-4088-a18f-7ebed81d0820 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-26300f55-63be-4088-a18f-7ebed81d0820 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:03.390263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:03.392496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:03.394414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:03.394414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:03.394414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:03.394414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:03.398581 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 251/514] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:03.399947 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26300f55-63be-4088-a18f-7ebed81d0820 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:03.412313 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0711f5e8-bf26-43f3-8234-b94845dc0c18 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:03.459531 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca938f-1c84-4726-a89d-7d9f18240781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:03.460687 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca938f-1c84-4726-a89d-7d9f18240781 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:03.461152 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca938f-1c84-4726-a89d-7d9f18240781 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:03.461642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ca938f-1c84-4726-a89d-7d9f18240781 None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:03.462918 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca938f-1c84-4726-a89d-7d9f18240781 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:03.463904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca938f-1c84-4726-a89d-7d9f18240781 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:03.465583 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ca938f-1c84-4726-a89d-7d9f18240781 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:03.496027 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 264/515] 10.222.0.25 () {56 vars in 1139 bytes} [Wed May 25 07:57:03 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:03.496027 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca938f-1c84-4726-a89d-7d9f18240781 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:03.512530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:03.537670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:03.603580 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26300f55-63be-4088-a18f-7ebed81d0820 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:03.629889 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ca938f-1c84-4726-a89d-7d9f18240781 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:03.663563 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13a75c-0afc-4bcc-80a9-6c507f859dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:03.664733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13a75c-0afc-4bcc-80a9-6c507f859dc1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:03.665420 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13a75c-0afc-4bcc-80a9-6c507f859dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:03.665934 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae13a75c-0afc-4bcc-80a9-6c507f859dc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:03.682872 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66997a27-5852-4c67-ac42-1f6fd386cba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:03.683994 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66997a27-5852-4c67-ac42-1f6fd386cba4 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:03.684518 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66997a27-5852-4c67-ac42-1f6fd386cba4 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:03.685005 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66997a27-5852-4c67-ac42-1f6fd386cba4 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:03.686396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66997a27-5852-4c67-ac42-1f6fd386cba4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:03.686890 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66997a27-5852-4c67-ac42-1f6fd386cba4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:03.689474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66997a27-5852-4c67-ac42-1f6fd386cba4 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:03.711402 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 265/516] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:03.712938 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66997a27-5852-4c67-ac42-1f6fd386cba4 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:03.774635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13a75c-0afc-4bcc-80a9-6c507f859dc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:03.776769 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae13a75c-0afc-4bcc-80a9-6c507f859dc1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:03.858758 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:03.888097 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:03.924817 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66997a27-5852-4c67-ac42-1f6fd386cba4 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:03.960557 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 252/517] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:57:03.960557 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13a75c-0afc-4bcc-80a9-6c507f859dc1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:03.984498 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e36af0-279b-4482-bd19-f54d71c1bfda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:03.985660 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e36af0-279b-4482-bd19-f54d71c1bfda None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:03.986219 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e36af0-279b-4482-bd19-f54d71c1bfda None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:03.986765 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e36af0-279b-4482-bd19-f54d71c1bfda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:04.103643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e36af0-279b-4482-bd19-f54d71c1bfda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:04.106275 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e36af0-279b-4482-bd19-f54d71c1bfda None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:04.127430 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae13a75c-0afc-4bcc-80a9-6c507f859dc1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:04.186171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5518b-0138-45f1-a3cb-6c13f439de41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:04.187475 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5518b-0138-45f1-a3cb-6c13f439de41 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:04.187939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5518b-0138-45f1-a3cb-6c13f439de41 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:04.188436 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5518b-0138-45f1-a3cb-6c13f439de41 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:04.200593 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5518b-0138-45f1-a3cb-6c13f439de41 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:04.202490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5518b-0138-45f1-a3cb-6c13f439de41 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-96b5518b-0138-45f1-a3cb-6c13f439de41 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:04.219216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:04.220937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:04.222655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:04.222655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:04.222655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:04.222655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:04.222655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:04.222655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:04.222655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:04.222655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:04.222655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 253/518] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:04.222655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5518b-0138-45f1-a3cb-6c13f439de41 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:04.228886 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:04.270482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:04.287346 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 266/519] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:57:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:57:04.289218 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e36af0-279b-4482-bd19-f54d71c1bfda None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:04.396032 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5518b-0138-45f1-a3cb-6c13f439de41 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:04.439101 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcfd3a-024e-4be3-8bbc-ba69875529b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:04.439945 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcfd3a-024e-4be3-8bbc-ba69875529b6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:04.440262 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcfd3a-024e-4be3-8bbc-ba69875529b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:04.440538 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defcfd3a-024e-4be3-8bbc-ba69875529b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:04.455525 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcfd3a-024e-4be3-8bbc-ba69875529b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:04.458906 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defcfd3a-024e-4be3-8bbc-ba69875529b6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-defcfd3a-024e-4be3-8bbc-ba69875529b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:04.480665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:04.482357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:04.484033 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:04.484033 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:04.484033 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:04.484033 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:04.484033 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 254/520] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:04.484033 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcfd3a-024e-4be3-8bbc-ba69875529b6 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:04.491819 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e36af0-279b-4482-bd19-f54d71c1bfda None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:04.535707 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b8a77-fddc-4ab2-a6d4-d7d86e37f649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:04.536452 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b8a77-fddc-4ab2-a6d4-d7d86e37f649 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:04.536739 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b8a77-fddc-4ab2-a6d4-d7d86e37f649 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:04.537020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b8a77-fddc-4ab2-a6d4-d7d86e37f649 None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:04.537831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b8a77-fddc-4ab2-a6d4-d7d86e37f649 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:04.538146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b8a77-fddc-4ab2-a6d4-d7d86e37f649 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:04.539655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b8a77-fddc-4ab2-a6d4-d7d86e37f649 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:04.565456 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 267/521] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:04.569262 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b8a77-fddc-4ab2-a6d4-d7d86e37f649 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:04.614922 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:04.636611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:04.654978 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defcfd3a-024e-4be3-8bbc-ba69875529b6 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:04.731086 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d40e4-60f0-491f-8424-7027cd01dcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:04.732927 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d40e4-60f0-491f-8424-7027cd01dcd4 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:04.733706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d40e4-60f0-491f-8424-7027cd01dcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:04.734412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6d40e4-60f0-491f-8424-7027cd01dcd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:04.759103 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d40e4-60f0-491f-8424-7027cd01dcd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:04.762614 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6d40e4-60f0-491f-8424-7027cd01dcd4 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-af6d40e4-60f0-491f-8424-7027cd01dcd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:04.803547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:04.805323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:04.806892 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:04.806892 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:04.806892 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:04.806892 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:04.807344 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 255/522] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:04.808822 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d40e4-60f0-491f-8424-7027cd01dcd4 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:04.863659 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b8a77-fddc-4ab2-a6d4-d7d86e37f649 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:04.933460 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234ac8-7389-4b1a-bd16-cd4bcfc5b07e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:04.934767 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234ac8-7389-4b1a-bd16-cd4bcfc5b07e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:04.935395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234ac8-7389-4b1a-bd16-cd4bcfc5b07e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:04.937107 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19234ac8-7389-4b1a-bd16-cd4bcfc5b07e None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:04.937482 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19234ac8-7389-4b1a-bd16-cd4bcfc5b07e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:04.938038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19234ac8-7389-4b1a-bd16-cd4bcfc5b07e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:04.940888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19234ac8-7389-4b1a-bd16-cd4bcfc5b07e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:04.971088 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 268/523] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:04.971088 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234ac8-7389-4b1a-bd16-cd4bcfc5b07e None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:04.989222 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6d40e4-60f0-491f-8424-7027cd01dcd4 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:05.043421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:05.056808 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67402af1-851f-4806-a40c-deb54e5131fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:05.058783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67402af1-851f-4806-a40c-deb54e5131fb None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:05.060455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67402af1-851f-4806-a40c-deb54e5131fb None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:05.061980 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67402af1-851f-4806-a40c-deb54e5131fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:05.061980 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67402af1-851f-4806-a40c-deb54e5131fb None admin] RBAC: Adding query filter params (role.id=032121f695584aebbac76f0f8ca183fa, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=0b9bc11432e04e779fffd35473e6fbfa) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:05.063924 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67402af1-851f-4806-a40c-deb54e5131fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:05.068888 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67402af1-851f-4806-a40c-deb54e5131fb None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:05.080676 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 256/524] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:57:04 2022] GET /identity/v3/role_assignments?user.id=0b9bc11432e04e779fffd35473e6fbfa&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=032121f695584aebbac76f0f8ca183fa => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:05.082378 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67402af1-851f-4806-a40c-deb54e5131fb None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:05.171142 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:05.186814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19234ac8-7389-4b1a-bd16-cd4bcfc5b07e None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:05.234385 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc346a12-2298-436b-bd6d-21141358790a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:05.235269 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346a12-2298-436b-bd6d-21141358790a None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:05.235734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346a12-2298-436b-bd6d-21141358790a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:05.236218 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc346a12-2298-436b-bd6d-21141358790a None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:05.237228 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc346a12-2298-436b-bd6d-21141358790a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:05.237750 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc346a12-2298-436b-bd6d-21141358790a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:05.239872 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc346a12-2298-436b-bd6d-21141358790a None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:05.255816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 269/525] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:05.257780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c1484-a730-4613-a290-0fa14b7d0e67 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:05.258224 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c1484-a730-4613-a290-0fa14b7d0e67 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:05.258635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717c1484-a730-4613-a290-0fa14b7d0e67 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:05.260637 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 270/526] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:05.266279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c1484-a730-4613-a290-0fa14b7d0e67 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:05.304032 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67402af1-851f-4806-a40c-deb54e5131fb None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:05.362907 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d51f541-463a-4fd4-a9fa-9ea5d74b1f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:05.363726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f541-463a-4fd4-a9fa-9ea5d74b1f71 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:05.364010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f541-463a-4fd4-a9fa-9ea5d74b1f71 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:05.364365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d51f541-463a-4fd4-a9fa-9ea5d74b1f71 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:05.373660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51f541-463a-4fd4-a9fa-9ea5d74b1f71 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:05.375905 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d51f541-463a-4fd4-a9fa-9ea5d74b1f71 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-0d51f541-463a-4fd4-a9fa-9ea5d74b1f71 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:05.394998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:05.396711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:05.399783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:05.399783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:05.399783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:05.399783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:05.399783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:05.399783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:05.399783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:05.399783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:05.399783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 257/527] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:05.399783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9752e-c717-4df1-9684-b20b9e0d6ff9 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:05.401927 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9752e-c717-4df1-9684-b20b9e0d6ff9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:05.401927 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be9752e-c717-4df1-9684-b20b9e0d6ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:05.422936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-6be9752e-c717-4df1-9684-b20b9e0d6ff9 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:05.424634 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-6be9752e-c717-4df1-9684-b20b9e0d6ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:05.434850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717c1484-a730-4613-a290-0fa14b7d0e67 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:05.483177 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc6ccd-9ce7-4d12-9b80-76deb115ce81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:05.484270 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc6ccd-9ce7-4d12-9b80-76deb115ce81 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:05.484730 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc6ccd-9ce7-4d12-9b80-76deb115ce81 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:05.485020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfc6ccd-9ce7-4d12-9b80-76deb115ce81 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:05.492101 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:05.492938 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc6ccd-9ce7-4d12-9b80-76deb115ce81 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:05.494458 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfc6ccd-9ce7-4d12-9b80-76deb115ce81 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-0dfc6ccd-9ce7-4d12-9b80-76deb115ce81 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:05.510769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:05.511768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:05.512674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:05.512674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:05.512674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:05.512674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:05.512674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:05.512674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:05.512674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:05.512674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:05.512674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 271/528] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:05.513162 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc6ccd-9ce7-4d12-9b80-76deb115ce81 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:05.526912 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 258/529] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:57:05.528104 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9752e-c717-4df1-9684-b20b9e0d6ff9 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:05.543728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:05.672246 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfc6ccd-9ce7-4d12-9b80-76deb115ce81 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:05.676786 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be9752e-c717-4df1-9684-b20b9e0d6ff9 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:05.717363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0cb58-4b7c-46a9-bfd9-72e7de79b1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:05.718041 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0cb58-4b7c-46a9-bfd9-72e7de79b1d0 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:05.718326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0cb58-4b7c-46a9-bfd9-72e7de79b1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:05.718511 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1198ad-b99f-46a3-8732-506655b8a922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:05.718654 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c0cb58-4b7c-46a9-bfd9-72e7de79b1d0 None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:05.719218 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1198ad-b99f-46a3-8732-506655b8a922 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:05.719456 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0cb58-4b7c-46a9-bfd9-72e7de79b1d0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:05.719589 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1198ad-b99f-46a3-8732-506655b8a922 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:05.719715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0cb58-4b7c-46a9-bfd9-72e7de79b1d0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:05.719833 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1198ad-b99f-46a3-8732-506655b8a922 None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:05.720584 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1198ad-b99f-46a3-8732-506655b8a922 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:05.720896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1198ad-b99f-46a3-8732-506655b8a922 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:05.721236 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c0cb58-4b7c-46a9-bfd9-72e7de79b1d0 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:05.722395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1198ad-b99f-46a3-8732-506655b8a922 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:05.747303 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 259/530] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:05.747551 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 272/531] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:05.747695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0cb58-4b7c-46a9-bfd9-72e7de79b1d0 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:05.748992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1198ad-b99f-46a3-8732-506655b8a922 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:05.809168 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:05.888373 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:05.922088 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c0cb58-4b7c-46a9-bfd9-72e7de79b1d0 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:05.942906 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1198ad-b99f-46a3-8732-506655b8a922 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:05.984786 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea2f50-62dd-4d98-b916-62a22911430c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:05.985788 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea2f50-62dd-4d98-b916-62a22911430c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:05.986294 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea2f50-62dd-4d98-b916-62a22911430c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:05.986497 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faea2f50-62dd-4d98-b916-62a22911430c None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:05.999096 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faea2f50-62dd-4d98-b916-62a22911430c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-faea2f50-62dd-4d98-b916-62a22911430c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:06.007372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:06.009401 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:06.020170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:06.020170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:06.020170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:06.020170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:06.020170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:06.020170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:06.020170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:06.020170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:06.020170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:06.020170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:06.020170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:06.020170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:06.021546 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944bdab-8152-453d-aace-b3c2df094255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:06.021713 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 260/532] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:06.021848 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944bdab-8152-453d-aace-b3c2df094255 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:06.021981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea2f50-62dd-4d98-b916-62a22911430c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:06.022131 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944bdab-8152-453d-aace-b3c2df094255 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:06.022131 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0944bdab-8152-453d-aace-b3c2df094255 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:06.022131 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944bdab-8152-453d-aace-b3c2df094255 None admin] RBAC: Adding query filter params (role.id=032121f695584aebbac76f0f8ca183fa, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=051dfda2a77e4648ae1f5ee47296499d) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:06.022131 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944bdab-8152-453d-aace-b3c2df094255 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:06.022131 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0944bdab-8152-453d-aace-b3c2df094255 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:06.031319 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 273/533] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:57:05 2022] GET /identity/v3/role_assignments?user.id=051dfda2a77e4648ae1f5ee47296499d&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=032121f695584aebbac76f0f8ca183fa => generated 259 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:06.037591 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944bdab-8152-453d-aace-b3c2df094255 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:06.230650 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faea2f50-62dd-4d98-b916-62a22911430c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:06.236164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:06.254424 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0944bdab-8152-453d-aace-b3c2df094255 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:06.301026 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28d669-098e-4cb8-a9c2-9e21d8efdc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:06.302385 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28d669-098e-4cb8-a9c2-9e21d8efdc2c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:06.303116 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28d669-098e-4cb8-a9c2-9e21d8efdc2c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:06.303822 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad28d669-098e-4cb8-a9c2-9e21d8efdc2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:06.305713 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28d669-098e-4cb8-a9c2-9e21d8efdc2c None admin] RBAC: Adding query filter params (role.id=032121f695584aebbac76f0f8ca183fa, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=e0eaeb03cb5f487f9640938b244fe210) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:06.306545 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28d669-098e-4cb8-a9c2-9e21d8efdc2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:06.310001 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad28d669-098e-4cb8-a9c2-9e21d8efdc2c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:06.320290 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15461667-584e-44cd-906c-35a933da7dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:06.321584 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15461667-584e-44cd-906c-35a933da7dd3 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:06.322127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15461667-584e-44cd-906c-35a933da7dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:06.323342 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15461667-584e-44cd-906c-35a933da7dd3 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:06.323806 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 261/534] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:57:06 2022] GET /identity/v3/role_assignments?user.id=e0eaeb03cb5f487f9640938b244fe210&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=032121f695584aebbac76f0f8ca183fa => generated 259 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:06.325107 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15461667-584e-44cd-906c-35a933da7dd3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:06.325790 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15461667-584e-44cd-906c-35a933da7dd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:06.328554 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15461667-584e-44cd-906c-35a933da7dd3 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:06.332973 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:06.344973 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 274/535] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:57:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:06.357083 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28d669-098e-4cb8-a9c2-9e21d8efdc2c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:06.565485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad28d669-098e-4cb8-a9c2-9e21d8efdc2c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:06.635085 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199b956-c422-4f43-96ed-ad626d86bfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:06.636497 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199b956-c422-4f43-96ed-ad626d86bfbc None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:06.636977 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199b956-c422-4f43-96ed-ad626d86bfbc None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:06.637484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199b956-c422-4f43-96ed-ad626d86bfbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:06.658870 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199b956-c422-4f43-96ed-ad626d86bfbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:06.661843 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199b956-c422-4f43-96ed-ad626d86bfbc None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-d199b956-c422-4f43-96ed-ad626d86bfbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:06.696648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:06.698268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:06.699950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:06.699950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:06.699950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:06.699950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:06.699950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 262/536] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:06.710806 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15461667-584e-44cd-906c-35a933da7dd3 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:06.924087 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15461667-584e-44cd-906c-35a933da7dd3 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:06.992248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5392a-1a87-4222-a8f8-e462433192ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:06.995259 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5392a-1a87-4222-a8f8-e462433192ae None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:06.996034 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5392a-1a87-4222-a8f8-e462433192ae None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:06.996839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba5392a-1a87-4222-a8f8-e462433192ae None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:06.998560 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5392a-1a87-4222-a8f8-e462433192ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:06.999400 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5392a-1a87-4222-a8f8-e462433192ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:07.002476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba5392a-1a87-4222-a8f8-e462433192ae None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:07.032253 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 275/537] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:07.037126 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199b956-c422-4f43-96ed-ad626d86bfbc None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:07.082169 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:07.250493 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199b956-c422-4f43-96ed-ad626d86bfbc None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:07.317220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c260b5-dde8-4870-8be6-3ef1138d5f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:07.317684 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c260b5-dde8-4870-8be6-3ef1138d5f10 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:07.319991 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c260b5-dde8-4870-8be6-3ef1138d5f10 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:07.319991 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c260b5-dde8-4870-8be6-3ef1138d5f10 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:07.334611 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c260b5-dde8-4870-8be6-3ef1138d5f10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:07.337393 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c260b5-dde8-4870-8be6-3ef1138d5f10 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-43c260b5-dde8-4870-8be6-3ef1138d5f10 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:07.367055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:07.368833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:07.370586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:07.370586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:07.370586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:07.370586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:07.370586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:07.370586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:07.370586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:07.370586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:07.370586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 07:57:07.370586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:07.370586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 263/538] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:57:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:07.382581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5392a-1a87-4222-a8f8-e462433192ae None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:07.507486 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:07.591959 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba5392a-1a87-4222-a8f8-e462433192ae None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:07.662695 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd36eba-a46a-4054-a764-5d629fef8b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:07.664865 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd36eba-a46a-4054-a764-5d629fef8b60 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:07.665692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd36eba-a46a-4054-a764-5d629fef8b60 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:07.667039 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd36eba-a46a-4054-a764-5d629fef8b60 None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:07.669037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd36eba-a46a-4054-a764-5d629fef8b60 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:07.669898 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd36eba-a46a-4054-a764-5d629fef8b60 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:07.673164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd36eba-a46a-4054-a764-5d629fef8b60 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:07.710927 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 276/539] 10.222.0.25 () {56 vars in 1137 bytes} [Wed May 25 07:57:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:07.721822 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c260b5-dde8-4870-8be6-3ef1138d5f10 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:07.839677 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:07.862742 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c260b5-dde8-4870-8be6-3ef1138d5f10 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:07.903407 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a9992-06aa-480c-95ce-f909f6e3508d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:07.904257 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a9992-06aa-480c-95ce-f909f6e3508d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:07.904550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a9992-06aa-480c-95ce-f909f6e3508d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:07.904831 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a9992-06aa-480c-95ce-f909f6e3508d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:07.917237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a9992-06aa-480c-95ce-f909f6e3508d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:07.918743 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8a9992-06aa-480c-95ce-f909f6e3508d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-7c8a9992-06aa-480c-95ce-f909f6e3508d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:07.938588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:07.940715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:07.943910 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:07.943910 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:07.943910 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:07.943910 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:07.945465 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 264/540] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:07.947400 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd36eba-a46a-4054-a764-5d629fef8b60 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:07.990163 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb29193-7005-49ac-bd6c-f84fcbc12300 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:07.990469 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb29193-7005-49ac-bd6c-f84fcbc12300 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:07.990728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb29193-7005-49ac-bd6c-f84fcbc12300 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:07.992737 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 265/541] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:57:08.003362 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d560b9-4a13-4a08-8411-18d09ea8e017 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:08.004265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d560b9-4a13-4a08-8411-18d09ea8e017 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:08.004265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d560b9-4a13-4a08-8411-18d09ea8e017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:08.021881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-a5d560b9-4a13-4a08-8411-18d09ea8e017 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:08.022948 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a5d560b9-4a13-4a08-8411-18d09ea8e017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:08.088845 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd36eba-a46a-4054-a764-5d629fef8b60 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:08.116731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:08.120264 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 266/542] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:57:08.144840 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dad3f9-8ca8-4fe0-9556-3263739a9e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:08.145975 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dad3f9-8ca8-4fe0-9556-3263739a9e94 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:08.147149 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d560b9-4a13-4a08-8411-18d09ea8e017 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:08.148579 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dad3f9-8ca8-4fe0-9556-3263739a9e94 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:08.149111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dad3f9-8ca8-4fe0-9556-3263739a9e94 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:08.150270 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dad3f9-8ca8-4fe0-9556-3263739a9e94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:08.151405 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dad3f9-8ca8-4fe0-9556-3263739a9e94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:08.153107 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dad3f9-8ca8-4fe0-9556-3263739a9e94 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:08.167236 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 277/543] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:08.173286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dad3f9-8ca8-4fe0-9556-3263739a9e94 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:08.243818 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:08.303506 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dad3f9-8ca8-4fe0-9556-3263739a9e94 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:08.304682 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d560b9-4a13-4a08-8411-18d09ea8e017 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:08.349475 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5f937-0146-488d-8ee2-8ee29d2f2b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:08.350421 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f937-0146-488d-8ee2-8ee29d2f2b77 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:08.350744 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f937-0146-488d-8ee2-8ee29d2f2b77 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:08.351105 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d5f937-0146-488d-8ee2-8ee29d2f2b77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:08.357692 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23101e1b-ecbf-4bcc-971d-a6fc7fb76b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:08.358845 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23101e1b-ecbf-4bcc-971d-a6fc7fb76b95 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:08.359626 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23101e1b-ecbf-4bcc-971d-a6fc7fb76b95 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:08.360091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23101e1b-ecbf-4bcc-971d-a6fc7fb76b95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:08.360458 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5f937-0146-488d-8ee2-8ee29d2f2b77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:08.362286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2d5f937-0146-488d-8ee2-8ee29d2f2b77 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:08.374138 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23101e1b-ecbf-4bcc-971d-a6fc7fb76b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-f2d5f937-0146-488d-8ee2-8ee29d2f2b77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:08.378281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:08.379135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:08.379973 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:08.379973 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:08.379973 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:08.379973 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:08.379973 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:08.379973 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:08.379973 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:08.379973 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:08.384532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 278/544] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:08.386142 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5f937-0146-488d-8ee2-8ee29d2f2b77 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-23101e1b-ecbf-4bcc-971d-a6fc7fb76b95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:08.386481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:08.387360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:08.388171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:08.388171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:08.388171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:08.388171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:08.388171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:08.388171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:08.388171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:08.388171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:08.388171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:08.388171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:08.388171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:08.388171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:08.392644 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 267/545] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:08.399511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23101e1b-ecbf-4bcc-971d-a6fc7fb76b95 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:08.447726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:08.553659 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23101e1b-ecbf-4bcc-971d-a6fc7fb76b95 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:08.561598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d5f937-0146-488d-8ee2-8ee29d2f2b77 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:08.589764 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:08.606351 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0be7c-cd12-487f-9307-1acd6b753f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:08.608021 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0be7c-cd12-487f-9307-1acd6b753f91 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:08.608882 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0be7c-cd12-487f-9307-1acd6b753f91 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:08.609319 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0be7c-cd12-487f-9307-1acd6b753f91 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:08.610254 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0be7c-cd12-487f-9307-1acd6b753f91 None admin] RBAC: Adding query filter params (name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:08.611054 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0be7c-cd12-487f-9307-1acd6b753f91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:08.613213 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0be7c-cd12-487f-9307-1acd6b753f91 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:08.623968 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719b66b-a032-4069-a03f-d68c1cda53a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:08.628356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719b66b-a032-4069-a03f-d68c1cda53a6 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:08.628356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719b66b-a032-4069-a03f-d68c1cda53a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:08.628356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e719b66b-a032-4069-a03f-d68c1cda53a6 None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:08.628356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719b66b-a032-4069-a03f-d68c1cda53a6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:08.628356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719b66b-a032-4069-a03f-d68c1cda53a6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:08.628356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e719b66b-a032-4069-a03f-d68c1cda53a6 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:08.629238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 268/546] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:57:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:08.632888 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0be7c-cd12-487f-9307-1acd6b753f91 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:08.644040 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 279/547] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:08.650178 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719b66b-a032-4069-a03f-d68c1cda53a6 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:08.767834 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:08.775451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e719b66b-a032-4069-a03f-d68c1cda53a6 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:08.786038 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0be7c-cd12-487f-9307-1acd6b753f91 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:08.825523 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f526cd1-dc9f-4a5b-881c-a39461cc6de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:08.826966 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f526cd1-dc9f-4a5b-881c-a39461cc6de6 None admin] REQUEST_METHOD: `PUT` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:08.827495 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f526cd1-dc9f-4a5b-881c-a39461cc6de6 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:08.828418 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f526cd1-dc9f-4a5b-881c-a39461cc6de6 None admin] PATH_INFO: `/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/6ca17baadab7473c81d80597fc0fa0f2/roles/032121f695584aebbac76f0f8ca183fa` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:08.839910 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c130470-4385-408f-a203-1bf8f2fa50d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:08.840907 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c130470-4385-408f-a203-1bf8f2fa50d8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:08.841119 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c130470-4385-408f-a203-1bf8f2fa50d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:08.841452 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c130470-4385-408f-a203-1bf8f2fa50d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:08.848757 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f526cd1-dc9f-4a5b-881c-a39461cc6de6 None admin] RBAC: Authorizing `identity:create_grant(project_id=b056475a8e394bb3bae06f030dee95ab, user_id=6ca17baadab7473c81d80597fc0fa0f2, role_id=032121f695584aebbac76f0f8ca183fa)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:08.851092 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f526cd1-dc9f-4a5b-881c-a39461cc6de6 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:08.855559 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c130470-4385-408f-a203-1bf8f2fa50d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:08.857112 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c130470-4385-408f-a203-1bf8f2fa50d8 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:08.871198 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 280/548] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:57:08 2022] PUT /identity/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/6ca17baadab7473c81d80597fc0fa0f2/roles/032121f695584aebbac76f0f8ca183fa => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-9c130470-4385-408f-a203-1bf8f2fa50d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:08.897574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:08.898482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:08.899834 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:08.899834 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:08.899834 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:08.899834 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:08.902410 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 269/549] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:08.912157 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f526cd1-dc9f-4a5b-881c-a39461cc6de6 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:09.035965 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f526cd1-dc9f-4a5b-881c-a39461cc6de6 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:09.079900 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554220c0-073a-4660-b062-152a09a00697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:09.080634 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554220c0-073a-4660-b062-152a09a00697 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:09.080922 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554220c0-073a-4660-b062-152a09a00697 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:09.081203 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554220c0-073a-4660-b062-152a09a00697 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:09.082049 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554220c0-073a-4660-b062-152a09a00697 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:09.082366 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554220c0-073a-4660-b062-152a09a00697 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:09.083792 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554220c0-073a-4660-b062-152a09a00697 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:09.097745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 281/550] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:09.105556 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c130470-4385-408f-a203-1bf8f2fa50d8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:09.176715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:09.259246 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c130470-4385-408f-a203-1bf8f2fa50d8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:09.297606 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6de239-1a69-4694-ac81-efe57f8d4791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:09.298654 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6de239-1a69-4694-ac81-efe57f8d4791 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:09.299112 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6de239-1a69-4694-ac81-efe57f8d4791 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:09.299526 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6de239-1a69-4694-ac81-efe57f8d4791 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:09.308376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6de239-1a69-4694-ac81-efe57f8d4791 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:09.310075 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6de239-1a69-4694-ac81-efe57f8d4791 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-ac6de239-1a69-4694-ac81-efe57f8d4791 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:09.325736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:09.326898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:09.328008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:09.328008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:09.328008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:09.328008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:09.328008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:09.328008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:09.328008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:09.328008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:09.328008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:57:09.328008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:09.330506 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 270/551] 10.222.0.25 () {56 vars in 1093 bytes} [Wed May 25 07:57:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:09.337156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554220c0-073a-4660-b062-152a09a00697 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:09.350633 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:09.360078 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df706-882b-4eb8-976b-c198d0e8f3d7 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:09.360720 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df706-882b-4eb8-976b-c198d0e8f3d7 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:09.361151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5df706-882b-4eb8-976b-c198d0e8f3d7 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:09.363288 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 271/552] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:09.373107 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bc63e-1621-4eb3-ade5-fc5201095a29 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:09.374168 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bc63e-1621-4eb3-ade5-fc5201095a29 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:09.374775 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bc63e-1621-4eb3-ade5-fc5201095a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:09.405674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-132bc63e-1621-4eb3-ade5-fc5201095a29 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:09.408300 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-132bc63e-1621-4eb3-ade5-fc5201095a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:09.460071 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554220c0-073a-4660-b062-152a09a00697 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:09.502744 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c11f4d-6c1d-47df-b257-70f7be005fc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:09.503622 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c11f4d-6c1d-47df-b257-70f7be005fc1 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:09.504079 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c11f4d-6c1d-47df-b257-70f7be005fc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:09.504761 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c11f4d-6c1d-47df-b257-70f7be005fc1 None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:09.505673 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c11f4d-6c1d-47df-b257-70f7be005fc1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:09.505966 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c11f4d-6c1d-47df-b257-70f7be005fc1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:09.507719 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c11f4d-6c1d-47df-b257-70f7be005fc1 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:09.525221 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 272/553] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:57:09.529983 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 282/554] 10.222.0.25 () {56 vars in 1133 bytes} [Wed May 25 07:57:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:09.535172 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bc63e-1621-4eb3-ade5-fc5201095a29 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:09.545017 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c11f4d-6c1d-47df-b257-70f7be005fc1 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:09.586530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:09.631632 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:09.696753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bc63e-1621-4eb3-ade5-fc5201095a29 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:09.718969 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c11f4d-6c1d-47df-b257-70f7be005fc1 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:09.743674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0a07bf-c805-45cc-9299-83d64daa6b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:09.745942 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a07bf-c805-45cc-9299-83d64daa6b9c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:09.746754 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a07bf-c805-45cc-9299-83d64daa6b9c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:09.747546 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0a07bf-c805-45cc-9299-83d64daa6b9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:09.763770 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a07bf-c805-45cc-9299-83d64daa6b9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:09.765865 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0a07bf-c805-45cc-9299-83d64daa6b9c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:09.773561 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414b46d-40db-47a3-9173-b80feda18f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:09.774967 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414b46d-40db-47a3-9173-b80feda18f7b None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:09.775440 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414b46d-40db-47a3-9173-b80feda18f7b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:09.776539 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414b46d-40db-47a3-9173-b80feda18f7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-ff0a07bf-c805-45cc-9299-83d64daa6b9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:09.787186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:09.788239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:09.789729 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:09.789729 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:09.789729 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:09.789729 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:09.789729 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 273/555] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:09.790535 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc1dcb-fa16-48a0-bb0b-5cc9175478b3 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:09.790827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc1dcb-fa16-48a0-bb0b-5cc9175478b3 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:09.791103 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cc1dcb-fa16-48a0-bb0b-5cc9175478b3 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:09.792682 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 274/556] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:09.794012 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc1dcb-fa16-48a0-bb0b-5cc9175478b3 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:09.801203 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414b46d-40db-47a3-9173-b80feda18f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-b414b46d-40db-47a3-9173-b80feda18f7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:09.815785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:09.816992 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 283/557] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:09.824396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36838b88-a024-49b8-ae8e-c2404c9133e2 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:09.825700 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36838b88-a024-49b8-ae8e-c2404c9133e2 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:09.825700 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36838b88-a024-49b8-ae8e-c2404c9133e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:09.841796 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-36838b88-a024-49b8-ae8e-c2404c9133e2 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:09.843117 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-36838b88-a024-49b8-ae8e-c2404c9133e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:09.912093 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:09.938697 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 284/558] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:57:09.939913 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36838b88-a024-49b8-ae8e-c2404c9133e2 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:09.948677 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cc1dcb-fa16-48a0-bb0b-5cc9175478b3 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:09.993673 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6bf8c-f27b-4173-9fe5-cc83f02c98ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:09.994244 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6bf8c-f27b-4173-9fe5-cc83f02c98ad None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:09.995079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6bf8c-f27b-4173-9fe5-cc83f02c98ad None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:09.995342 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac6bf8c-f27b-4173-9fe5-cc83f02c98ad None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:09.996097 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6bf8c-f27b-4173-9fe5-cc83f02c98ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:09.996460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6bf8c-f27b-4173-9fe5-cc83f02c98ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:09.997984 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac6bf8c-f27b-4173-9fe5-cc83f02c98ad None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:10.018529 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 275/559] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:10.018529 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6bf8c-f27b-4173-9fe5-cc83f02c98ad None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:10.064708 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:10.141365 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36838b88-a024-49b8-ae8e-c2404c9133e2 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:10.153754 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac6bf8c-f27b-4173-9fe5-cc83f02c98ad None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:10.180498 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c162e7-9399-4d22-8722-32d19769418f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:10.181222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c162e7-9399-4d22-8722-32d19769418f None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:10.181457 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c162e7-9399-4d22-8722-32d19769418f None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:10.181732 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c162e7-9399-4d22-8722-32d19769418f None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:10.183047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c162e7-9399-4d22-8722-32d19769418f None admin] RBAC: Adding query filter params (name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:10.183361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c162e7-9399-4d22-8722-32d19769418f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:10.184796 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c162e7-9399-4d22-8722-32d19769418f None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:10.194671 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 285/560] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:57:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:10.195538 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c162e7-9399-4d22-8722-32d19769418f None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:10.202943 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2a097-518d-427d-9ebb-70b87a852eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:10.203768 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2a097-518d-427d-9ebb-70b87a852eb8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:10.204065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2a097-518d-427d-9ebb-70b87a852eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:10.204382 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b2a097-518d-427d-9ebb-70b87a852eb8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:10.213241 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:10.219440 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b2a097-518d-427d-9ebb-70b87a852eb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-18b2a097-518d-427d-9ebb-70b87a852eb8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:10.227630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:10.228718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:10.229564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:10.229564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:10.229564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:10.229564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:10.229564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:10.229564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:10.229564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:10.229564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:10.229564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:10.229564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:10.229564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:10.229564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:10.229564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 276/561] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:10.230750 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2a097-518d-427d-9ebb-70b87a852eb8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:10.324715 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c162e7-9399-4d22-8722-32d19769418f None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:10.342922 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:10.353027 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b2a097-518d-427d-9ebb-70b87a852eb8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:10.363027 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51977972-54c5-440c-9cd9-98a979f41e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:10.363842 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51977972-54c5-440c-9cd9-98a979f41e94 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:10.364152 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51977972-54c5-440c-9cd9-98a979f41e94 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:10.364443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51977972-54c5-440c-9cd9-98a979f41e94 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:10.372513 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51977972-54c5-440c-9cd9-98a979f41e94 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:10.373995 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51977972-54c5-440c-9cd9-98a979f41e94 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-51977972-54c5-440c-9cd9-98a979f41e94 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:10.388999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:10.390130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:10.391329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:10.391329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:10.391329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:10.391329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:10.391329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:10.391329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:10.391329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:10.391329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:10.391329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 286/562] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:10.391329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51977972-54c5-440c-9cd9-98a979f41e94 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:10.400257 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb71fa3-4d5f-4971-87a3-e5d36109f601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:10.401408 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb71fa3-4d5f-4971-87a3-e5d36109f601 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:10.401873 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb71fa3-4d5f-4971-87a3-e5d36109f601 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:10.402322 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb71fa3-4d5f-4971-87a3-e5d36109f601 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:10.420249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb71fa3-4d5f-4971-87a3-e5d36109f601 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:10.422546 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb71fa3-4d5f-4971-87a3-e5d36109f601 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-aeb71fa3-4d5f-4971-87a3-e5d36109f601 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:10.452357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:10.454448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:10.456253 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:10.456253 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:10.456253 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:10.456253 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:10.456253 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 277/563] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:10.456253 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb71fa3-4d5f-4971-87a3-e5d36109f601 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:10.533969 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:10.566570 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51977972-54c5-440c-9cd9-98a979f41e94 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:10.610369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dc238-a062-4f32-9bd4-f7e6c64d62f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:10.611049 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dc238-a062-4f32-9bd4-f7e6c64d62f8 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:10.611343 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dc238-a062-4f32-9bd4-f7e6c64d62f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:10.611590 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb71fa3-4d5f-4971-87a3-e5d36109f601 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:10.611717 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76dc238-a062-4f32-9bd4-f7e6c64d62f8 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:10.612397 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dc238-a062-4f32-9bd4-f7e6c64d62f8 None admin] RBAC: Adding query filter params (name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:10.612711 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dc238-a062-4f32-9bd4-f7e6c64d62f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:10.614108 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76dc238-a062-4f32-9bd4-f7e6c64d62f8 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:10.634773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 287/564] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:57:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:10.634773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dc238-a062-4f32-9bd4-f7e6c64d62f8 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:10.680170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6a367-ee94-4f26-9736-c5bad1500333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:10.681242 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6a367-ee94-4f26-9736-c5bad1500333 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:10.681674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6a367-ee94-4f26-9736-c5bad1500333 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:10.682170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c6a367-ee94-4f26-9736-c5bad1500333 None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:10.683602 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6a367-ee94-4f26-9736-c5bad1500333 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:10.684057 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6a367-ee94-4f26-9736-c5bad1500333 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:10.686366 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c6a367-ee94-4f26-9736-c5bad1500333 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:10.707013 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:10.713158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 278/565] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:10.713158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6a367-ee94-4f26-9736-c5bad1500333 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:10.808691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76dc238-a062-4f32-9bd4-f7e6c64d62f8 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:10.858113 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161bef-c729-4096-bbf7-289b2a32d675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:10.858691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161bef-c729-4096-bbf7-289b2a32d675 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:10.858983 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161bef-c729-4096-bbf7-289b2a32d675 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:10.859264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59161bef-c729-4096-bbf7-289b2a32d675 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:10.860026 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59161bef-c729-4096-bbf7-289b2a32d675 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:10.860446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59161bef-c729-4096-bbf7-289b2a32d675 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:10.860889 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c6a367-ee94-4f26-9736-c5bad1500333 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:10.862393 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59161bef-c729-4096-bbf7-289b2a32d675 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:10.879054 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:10.888759 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 288/566] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:10.888759 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161bef-c729-4096-bbf7-289b2a32d675 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:10.927864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f02db1-1136-4cb3-a2d7-325c9a284c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:10.929204 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f02db1-1136-4cb3-a2d7-325c9a284c92 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:10.929677 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f02db1-1136-4cb3-a2d7-325c9a284c92 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:10.930203 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f02db1-1136-4cb3-a2d7-325c9a284c92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:10.949176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f02db1-1136-4cb3-a2d7-325c9a284c92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:10.951337 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f02db1-1136-4cb3-a2d7-325c9a284c92 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-10f02db1-1136-4cb3-a2d7-325c9a284c92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:10.983643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:10.984679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:10.985538 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:10.985538 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:10.985538 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:10.985538 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:10.986201 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 279/567] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:10.987425 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f02db1-1136-4cb3-a2d7-325c9a284c92 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:11.022103 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:11.028933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59161bef-c729-4096-bbf7-289b2a32d675 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:11.093542 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ad618-4212-4f47-adb2-2889dd98604f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:11.095058 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ad618-4212-4f47-adb2-2889dd98604f None admin] REQUEST_METHOD: `PUT` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:11.095507 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ad618-4212-4f47-adb2-2889dd98604f None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:11.095946 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8ad618-4212-4f47-adb2-2889dd98604f None admin] PATH_INFO: `/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/0b9bc11432e04e779fffd35473e6fbfa/roles/032121f695584aebbac76f0f8ca183fa` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:11.122359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ad618-4212-4f47-adb2-2889dd98604f None admin] RBAC: Authorizing `identity:create_grant(project_id=b056475a8e394bb3bae06f030dee95ab, user_id=0b9bc11432e04e779fffd35473e6fbfa, role_id=032121f695584aebbac76f0f8ca183fa)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:11.124458 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8ad618-4212-4f47-adb2-2889dd98604f None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:11.164162 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 289/568] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:57:10 2022] PUT /identity/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/0b9bc11432e04e779fffd35473e6fbfa/roles/032121f695584aebbac76f0f8ca183fa => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:57:11.164162 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ad618-4212-4f47-adb2-2889dd98604f None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:11.172250 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f02db1-1136-4cb3-a2d7-325c9a284c92 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:11.245248 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cb666-f887-466b-b19d-f559a6755025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:11.246831 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cb666-f887-466b-b19d-f559a6755025 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:11.247425 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cb666-f887-466b-b19d-f559a6755025 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:11.248004 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7cb666-f887-466b-b19d-f559a6755025 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:11.263837 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cb666-f887-466b-b19d-f559a6755025 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:11.267350 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7cb666-f887-466b-b19d-f559a6755025 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-dd7cb666-f887-466b-b19d-f559a6755025 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:11.295917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:11.297792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:11.300484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:11.300484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:11.300484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:11.300484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:11.300484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:11.300484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:11.300484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:11.300484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:11.300484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:57:11.300484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:11.300484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 280/569] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:57:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:11.308157 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cb666-f887-466b-b19d-f559a6755025 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:11.343706 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8ad618-4212-4f47-adb2-2889dd98604f None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:11.364684 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:11.386515 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca0e32-b498-48f5-bdfd-5cdfd89ffaa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:11.387113 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca0e32-b498-48f5-bdfd-5cdfd89ffaa7 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:11.387399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca0e32-b498-48f5-bdfd-5cdfd89ffaa7 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:11.387678 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ca0e32-b498-48f5-bdfd-5cdfd89ffaa7 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:11.388469 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca0e32-b498-48f5-bdfd-5cdfd89ffaa7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:11.388780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca0e32-b498-48f5-bdfd-5cdfd89ffaa7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:11.390476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ca0e32-b498-48f5-bdfd-5cdfd89ffaa7 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:11.405238 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 290/570] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:11.414919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca0e32-b498-48f5-bdfd-5cdfd89ffaa7 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:11.438349 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:11.584320 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ca0e32-b498-48f5-bdfd-5cdfd89ffaa7 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:11.602898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7cb666-f887-466b-b19d-f559a6755025 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:11.629833 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ccc3e6-489e-4833-a0b8-9634a1257213 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:11.630701 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccc3e6-489e-4833-a0b8-9634a1257213 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:11.630988 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccc3e6-489e-4833-a0b8-9634a1257213 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:11.631271 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ccc3e6-489e-4833-a0b8-9634a1257213 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:11.642512 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccc3e6-489e-4833-a0b8-9634a1257213 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:11.644013 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ccc3e6-489e-4833-a0b8-9634a1257213 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:11.649083 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d880a52a-bbf2-4ae0-9186-2bcd72dea6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:11.649936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880a52a-bbf2-4ae0-9186-2bcd72dea6e2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:11.650350 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880a52a-bbf2-4ae0-9186-2bcd72dea6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:11.650801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d880a52a-bbf2-4ae0-9186-2bcd72dea6e2 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:11.651932 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880a52a-bbf2-4ae0-9186-2bcd72dea6e2 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:11.652443 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880a52a-bbf2-4ae0-9186-2bcd72dea6e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:11.654038 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d880a52a-bbf2-4ae0-9186-2bcd72dea6e2 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-50ccc3e6-489e-4833-a0b8-9634a1257213 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:11.663572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:11.664642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:11.665655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:11.665655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:11.665655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:11.665655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:11.665655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:11.665655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:11.665655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:11.665655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:11.665655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 07:57:11.665655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:11.665655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 291/571] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:11.667450 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc523e-9687-4672-b50a-fe64382c0047 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:11.667934 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc523e-9687-4672-b50a-fe64382c0047 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:11.668449 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc523e-9687-4672-b50a-fe64382c0047 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:11.671476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 292/572] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:11.673886 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc523e-9687-4672-b50a-fe64382c0047 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:11.691703 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 281/573] 10.222.0.25 () {56 vars in 1137 bytes} [Wed May 25 07:57:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:11.694473 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a0b0e-bd60-465d-82be-b614a2778f8a None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:11.695267 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a0b0e-bd60-465d-82be-b614a2778f8a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:11.696468 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809a0b0e-bd60-465d-82be-b614a2778f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:11.723593 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-809a0b0e-bd60-465d-82be-b614a2778f8a None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:11.726009 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-809a0b0e-bd60-465d-82be-b614a2778f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:11.775577 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:11.827866 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 282/574] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:57:11.829105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a0b0e-bd60-465d-82be-b614a2778f8a None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:11.840952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc523e-9687-4672-b50a-fe64382c0047 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:11.848997 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:11.899742 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe7ef6-8edc-4289-9bee-7d732995103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:11.900740 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe7ef6-8edc-4289-9bee-7d732995103c None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:11.901190 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe7ef6-8edc-4289-9bee-7d732995103c None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:11.901471 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe7ef6-8edc-4289-9bee-7d732995103c None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:11.902439 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe7ef6-8edc-4289-9bee-7d732995103c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:11.902878 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe7ef6-8edc-4289-9bee-7d732995103c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:11.908282 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe7ef6-8edc-4289-9bee-7d732995103c None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:11.927867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 293/575] 10.222.0.25 () {56 vars in 1139 bytes} [Wed May 25 07:57:11 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:11.928774 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe7ef6-8edc-4289-9bee-7d732995103c None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:11.992614 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809a0b0e-bd60-465d-82be-b614a2778f8a None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:12.054904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe7ef6-8edc-4289-9bee-7d732995103c None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:12.058539 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d003ab-e51e-4dda-8298-322eb4f12493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:12.059967 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d003ab-e51e-4dda-8298-322eb4f12493 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:12.060519 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d003ab-e51e-4dda-8298-322eb4f12493 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:12.061014 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d003ab-e51e-4dda-8298-322eb4f12493 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:12.076735 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d003ab-e51e-4dda-8298-322eb4f12493 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:12.078291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d003ab-e51e-4dda-8298-322eb4f12493 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-c0d003ab-e51e-4dda-8298-322eb4f12493 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:12.098696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:12.099657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:12.105510 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:12.105510 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:12.105510 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:12.105510 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:12.105510 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 283/576] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:12.105510 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d003ab-e51e-4dda-8298-322eb4f12493 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:12.110604 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:12.126034 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72bbde-a849-47da-8327-e815d92103ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:12.126931 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72bbde-a849-47da-8327-e815d92103ce None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:12.127623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72bbde-a849-47da-8327-e815d92103ce None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:12.128114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a72bbde-a849-47da-8327-e815d92103ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:12.148072 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a72bbde-a849-47da-8327-e815d92103ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-9a72bbde-a849-47da-8327-e815d92103ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:12.164293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:12.167050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:12.168970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:12.168970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:12.168970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:12.168970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:12.168970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:12.168970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:12.168970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:12.168970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:12.168970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:12.168970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:12.168970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:12.168970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:12.168970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 294/577] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:12.171660 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72bbde-a849-47da-8327-e815d92103ce None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:12.186927 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:12.264562 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d003ab-e51e-4dda-8298-322eb4f12493 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:12.317918 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a72bbde-a849-47da-8327-e815d92103ce None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:12.321324 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cead4f3-752a-4072-a44e-78f90d8b2491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:12.322435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cead4f3-752a-4072-a44e-78f90d8b2491 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:12.323310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cead4f3-752a-4072-a44e-78f90d8b2491 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:12.323676 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cead4f3-752a-4072-a44e-78f90d8b2491 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:12.340437 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cead4f3-752a-4072-a44e-78f90d8b2491 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:12.342727 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cead4f3-752a-4072-a44e-78f90d8b2491 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-0cead4f3-752a-4072-a44e-78f90d8b2491 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:12.364265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:12.365412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:12.371896 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:12.371896 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:12.371896 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:12.371896 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:12.371896 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 284/578] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:12.371896 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cead4f3-752a-4072-a44e-78f90d8b2491 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:12.373592 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7234352-cb20-46be-aef3-52f4ca076b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:12.374604 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234352-cb20-46be-aef3-52f4ca076b7d None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:12.375054 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234352-cb20-46be-aef3-52f4ca076b7d None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:12.375521 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7234352-cb20-46be-aef3-52f4ca076b7d None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:12.376437 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7234352-cb20-46be-aef3-52f4ca076b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:12.376954 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7234352-cb20-46be-aef3-52f4ca076b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:12.379337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7234352-cb20-46be-aef3-52f4ca076b7d None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:12.403959 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 295/579] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:12.403959 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7234352-cb20-46be-aef3-52f4ca076b7d None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:12.478640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:12.530389 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cead4f3-752a-4072-a44e-78f90d8b2491 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:12.553653 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:12.569053 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7234352-cb20-46be-aef3-52f4ca076b7d None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:12.584701 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87c4f-9dc9-4b30-97d9-57bce500b82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:12.585388 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87c4f-9dc9-4b30-97d9-57bce500b82f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:12.585671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87c4f-9dc9-4b30-97d9-57bce500b82f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:12.585943 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb87c4f-9dc9-4b30-97d9-57bce500b82f None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:12.586701 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb87c4f-9dc9-4b30-97d9-57bce500b82f None admin] RBAC: Adding query filter params (name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:12.587450 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb87c4f-9dc9-4b30-97d9-57bce500b82f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:12.588943 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb87c4f-9dc9-4b30-97d9-57bce500b82f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:12.601166 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 285/580] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:57:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:12.601945 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87c4f-9dc9-4b30-97d9-57bce500b82f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:12.634198 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf489b7-997c-4df2-ba1b-11ad96b740b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:12.636386 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf489b7-997c-4df2-ba1b-11ad96b740b2 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:12.637193 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf489b7-997c-4df2-ba1b-11ad96b740b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:12.638198 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf489b7-997c-4df2-ba1b-11ad96b740b2 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:12.639884 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf489b7-997c-4df2-ba1b-11ad96b740b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:12.641013 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf489b7-997c-4df2-ba1b-11ad96b740b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:12.643837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf489b7-997c-4df2-ba1b-11ad96b740b2 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:12.665806 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 296/581] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:12.667913 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf489b7-997c-4df2-ba1b-11ad96b740b2 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:12.777756 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb87c4f-9dc9-4b30-97d9-57bce500b82f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:12.823150 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf489b7-997c-4df2-ba1b-11ad96b740b2 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:12.828625 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3bdab-1063-4605-b8bb-8864a5f2b236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:12.829435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3bdab-1063-4605-b8bb-8864a5f2b236 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:12.829781 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3bdab-1063-4605-b8bb-8864a5f2b236 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:12.830061 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e3bdab-1063-4605-b8bb-8864a5f2b236 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:12.835340 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:12.838631 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3bdab-1063-4605-b8bb-8864a5f2b236 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:12.840159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e3bdab-1063-4605-b8bb-8864a5f2b236 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-50e3bdab-1063-4605-b8bb-8864a5f2b236 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:12.856636 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:12.858697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:12.860532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:12.860532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:12.860532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:12.860532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:12.860532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:12.860532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:12.860532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:12.860532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:12.860532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 286/582] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:12.860532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3bdab-1063-4605-b8bb-8864a5f2b236 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:12.899124 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a65742-881f-4cb9-a05e-0f22a7692d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:12.901358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a65742-881f-4cb9-a05e-0f22a7692d4e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:12.901883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a65742-881f-4cb9-a05e-0f22a7692d4e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:12.902397 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a65742-881f-4cb9-a05e-0f22a7692d4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:12.916908 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:12.925115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a65742-881f-4cb9-a05e-0f22a7692d4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:12.928377 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a65742-881f-4cb9-a05e-0f22a7692d4e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-32a65742-881f-4cb9-a05e-0f22a7692d4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:12.961090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:12.962111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:12.963603 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:12.963603 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:12.963603 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:12.963603 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:12.970742 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 297/583] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:12.970742 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a65742-881f-4cb9-a05e-0f22a7692d4e None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:13.004770 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e3bdab-1063-4605-b8bb-8864a5f2b236 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:13.055322 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa10f0c-9091-4b59-9603-e6d95368d34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:13.056464 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa10f0c-9091-4b59-9603-e6d95368d34f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:13.057278 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa10f0c-9091-4b59-9603-e6d95368d34f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:13.057707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa10f0c-9091-4b59-9603-e6d95368d34f None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:13.065893 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa10f0c-9091-4b59-9603-e6d95368d34f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:13.067354 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa10f0c-9091-4b59-9603-e6d95368d34f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-5fa10f0c-9091-4b59-9603-e6d95368d34f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:13.092894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:13.094251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:13.095414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:13.095414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:13.095414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:13.095414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:13.095414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:13.095414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:13.095414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:13.095414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:13.095414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 287/584] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:13.096844 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa10f0c-9091-4b59-9603-e6d95368d34f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:13.112544 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a65742-881f-4cb9-a05e-0f22a7692d4e None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:13.174516 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981ada0-a1e1-4f72-b9fc-cea9fe09eb5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:13.175702 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981ada0-a1e1-4f72-b9fc-cea9fe09eb5d None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:13.176378 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981ada0-a1e1-4f72-b9fc-cea9fe09eb5d None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:13.176889 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0981ada0-a1e1-4f72-b9fc-cea9fe09eb5d None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:13.178552 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981ada0-a1e1-4f72-b9fc-cea9fe09eb5d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:13.179719 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981ada0-a1e1-4f72-b9fc-cea9fe09eb5d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:13.181848 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0981ada0-a1e1-4f72-b9fc-cea9fe09eb5d None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:13.213982 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 298/585] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:13.213982 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981ada0-a1e1-4f72-b9fc-cea9fe09eb5d None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:13.235671 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:13.255478 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:13.267949 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa10f0c-9091-4b59-9603-e6d95368d34f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:13.332093 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1dc40-ed95-41e7-80e4-fa4220e5d258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:13.333200 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1dc40-ed95-41e7-80e4-fa4220e5d258 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:13.333710 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1dc40-ed95-41e7-80e4-fa4220e5d258 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:13.334218 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc1dc40-ed95-41e7-80e4-fa4220e5d258 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:13.335613 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1dc40-ed95-41e7-80e4-fa4220e5d258 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:13.336238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1dc40-ed95-41e7-80e4-fa4220e5d258 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:13.339197 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc1dc40-ed95-41e7-80e4-fa4220e5d258 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:13.341728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0981ada0-a1e1-4f72-b9fc-cea9fe09eb5d None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:13.359163 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 288/586] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:13.360687 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1dc40-ed95-41e7-80e4-fa4220e5d258 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:13.399028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b6611-8261-4cb0-b182-537e1da7d7ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:13.400063 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b6611-8261-4cb0-b182-537e1da7d7ca None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:13.401271 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b6611-8261-4cb0-b182-537e1da7d7ca None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:13.401519 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b6611-8261-4cb0-b182-537e1da7d7ca None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:13.402550 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b6611-8261-4cb0-b182-537e1da7d7ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:13.402867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b6611-8261-4cb0-b182-537e1da7d7ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:13.404882 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b6611-8261-4cb0-b182-537e1da7d7ca None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:13.426216 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 299/587] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:13.426216 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b6611-8261-4cb0-b182-537e1da7d7ca None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:13.501542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc1dc40-ed95-41e7-80e4-fa4220e5d258 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:13.539368 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:13.547632 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da912e9-ce9e-4121-b5cf-8553dfb05484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:13.548640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da912e9-ce9e-4121-b5cf-8553dfb05484 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:13.548994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da912e9-ce9e-4121-b5cf-8553dfb05484 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:13.549285 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da912e9-ce9e-4121-b5cf-8553dfb05484 None admin] PATH_INFO: `/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/051dfda2a77e4648ae1f5ee47296499d/roles/032121f695584aebbac76f0f8ca183fa` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:13.567729 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da912e9-ce9e-4121-b5cf-8553dfb05484 None admin] RBAC: Authorizing `identity:create_grant(project_id=b056475a8e394bb3bae06f030dee95ab, user_id=051dfda2a77e4648ae1f5ee47296499d, role_id=032121f695584aebbac76f0f8ca183fa)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:13.570574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da912e9-ce9e-4121-b5cf-8553dfb05484 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:13.583532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b6611-8261-4cb0-b182-537e1da7d7ca None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:13.600158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 289/588] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:57:13 2022] PUT /identity/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/051dfda2a77e4648ae1f5ee47296499d/roles/032121f695584aebbac76f0f8ca183fa => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:57:13.600158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da912e9-ce9e-4121-b5cf-8553dfb05484 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:13.616926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:13.638003 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113d190-76ca-4a57-b6b7-03a98ee84234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:13.638835 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113d190-76ca-4a57-b6b7-03a98ee84234 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:13.639123 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113d190-76ca-4a57-b6b7-03a98ee84234 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:13.639405 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5113d190-76ca-4a57-b6b7-03a98ee84234 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:13.648852 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113d190-76ca-4a57-b6b7-03a98ee84234 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:13.650396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5113d190-76ca-4a57-b6b7-03a98ee84234 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-5113d190-76ca-4a57-b6b7-03a98ee84234 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:13.667465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:13.668522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:13.669463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:13.669463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:13.669463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:13.669463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:13.669463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:13.669463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:13.669463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:13.669463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:13.669463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 25 07:57:13.669463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:13.669463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 300/589] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:57:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:13.677880 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113d190-76ca-4a57-b6b7-03a98ee84234 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:13.768553 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da912e9-ce9e-4121-b5cf-8553dfb05484 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:13.834685 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5113d190-76ca-4a57-b6b7-03a98ee84234 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:13.834942 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdedeca3-7c44-4036-afd5-9615d8092bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:13.836046 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedeca3-7c44-4036-afd5-9615d8092bb9 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:13.836532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedeca3-7c44-4036-afd5-9615d8092bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:13.836957 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdedeca3-7c44-4036-afd5-9615d8092bb9 None admin] PATH_INFO: `/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/e0eaeb03cb5f487f9640938b244fe210/roles/032121f695584aebbac76f0f8ca183fa` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:13.863679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedeca3-7c44-4036-afd5-9615d8092bb9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b056475a8e394bb3bae06f030dee95ab, user_id=e0eaeb03cb5f487f9640938b244fe210, role_id=032121f695584aebbac76f0f8ca183fa)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:13.865951 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdedeca3-7c44-4036-afd5-9615d8092bb9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:13.893001 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8630a-5379-42ee-b625-2c65b67376ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:13.894132 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8630a-5379-42ee-b625-2c65b67376ab None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:13.894594 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8630a-5379-42ee-b625-2c65b67376ab None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:13.895066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba8630a-5379-42ee-b625-2c65b67376ab None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:13.896565 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8630a-5379-42ee-b625-2c65b67376ab None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:13.897066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8630a-5379-42ee-b625-2c65b67376ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:13.905192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 290/590] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:57:13 2022] PUT /identity/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/e0eaeb03cb5f487f9640938b244fe210/roles/032121f695584aebbac76f0f8ca183fa => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:57:13.905452 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba8630a-5379-42ee-b625-2c65b67376ab None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:13.905625 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6ede0-bad8-4eab-9f29-b9a0bdfa341d None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:13.905625 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6ede0-bad8-4eab-9f29-b9a0bdfa341d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:13.905625 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab6ede0-bad8-4eab-9f29-b9a0bdfa341d None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:13.905625 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 291/591] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:13.912458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbf7b3-96cc-4c12-a9eb-bdfa3a8e6919 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:13.912868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbf7b3-96cc-4c12-a9eb-bdfa3a8e6919 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:13.913155 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bbf7b3-96cc-4c12-a9eb-bdfa3a8e6919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:13.917067 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:13.932902 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 301/592] 10.222.0.25 () {56 vars in 1137 bytes} [Wed May 25 07:57:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:13.937197 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-31bbf7b3-96cc-4c12-a9eb-bdfa3a8e6919 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:13.938208 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8630a-5379-42ee-b625-2c65b67376ab None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:13.938509 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-31bbf7b3-96cc-4c12-a9eb-bdfa3a8e6919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:14.070184 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:14.115610 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 292/593] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:57:14.133063 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba8630a-5379-42ee-b625-2c65b67376ab None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:14.164954 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbf7b3-96cc-4c12-a9eb-bdfa3a8e6919 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:14.190471 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe9a75-415c-444d-997f-ca3ab3bc90e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:14.191260 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe9a75-415c-444d-997f-ca3ab3bc90e9 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:14.191617 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe9a75-415c-444d-997f-ca3ab3bc90e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:14.191798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fe9a75-415c-444d-997f-ca3ab3bc90e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:14.313236 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:14.332082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe9a75-415c-444d-997f-ca3ab3bc90e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:14.333839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fe9a75-415c-444d-997f-ca3ab3bc90e9 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:14.360091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bbf7b3-96cc-4c12-a9eb-bdfa3a8e6919 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:14.437131 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9d1da-64a5-4920-a290-bf36365301b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:14.439813 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9d1da-64a5-4920-a290-bf36365301b2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:14.440754 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9d1da-64a5-4920-a290-bf36365301b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:14.441726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9d1da-64a5-4920-a290-bf36365301b2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:14.465497 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9d1da-64a5-4920-a290-bf36365301b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-dbb9d1da-64a5-4920-a290-bf36365301b2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:14.487159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:14.488551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:14.490192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:14.490192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:14.490192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:14.490192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:14.490192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:14.490192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:14.490192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:14.490192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:14.490192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:14.490192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:14.490192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:14.490192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:14.491201 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 293/594] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:14.499869 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9d1da-64a5-4920-a290-bf36365301b2 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:14.527043 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 302/595] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:57:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:57:14.537095 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe9a75-415c-444d-997f-ca3ab3bc90e9 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:14.599344 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:14.708017 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9d1da-64a5-4920-a290-bf36365301b2 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:14.741900 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:14.749029 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fe9a75-415c-444d-997f-ca3ab3bc90e9 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:14.775254 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d916c-0ab9-47ed-9493-cefdd722f967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:14.776744 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d916c-0ab9-47ed-9493-cefdd722f967 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:14.777238 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d916c-0ab9-47ed-9493-cefdd722f967 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:14.778433 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93d916c-0ab9-47ed-9493-cefdd722f967 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:14.782815 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d916c-0ab9-47ed-9493-cefdd722f967 None admin] RBAC: Adding query filter params (name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:14.782815 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d916c-0ab9-47ed-9493-cefdd722f967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:14.785621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93d916c-0ab9-47ed-9493-cefdd722f967 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:14.802053 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 294/596] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:57:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:14.809178 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d916c-0ab9-47ed-9493-cefdd722f967 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:14.825320 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a99b0-1802-4b90-a987-9155b20f11ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:14.826692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a99b0-1802-4b90-a987-9155b20f11ea None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:14.827215 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a99b0-1802-4b90-a987-9155b20f11ea None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:14.827735 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72a99b0-1802-4b90-a987-9155b20f11ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:14.849054 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a99b0-1802-4b90-a987-9155b20f11ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:14.851725 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72a99b0-1802-4b90-a987-9155b20f11ea None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-c72a99b0-1802-4b90-a987-9155b20f11ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:14.889446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:14.890606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:14.891489 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:14.891489 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:14.891489 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:14.891489 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:14.892631 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 303/597] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:14.901139 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a99b0-1802-4b90-a987-9155b20f11ea None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:14.985418 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93d916c-0ab9-47ed-9493-cefdd722f967 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:15.002966 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:15.064388 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccc797-0002-4048-8521-2f55230629c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:15.067027 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccc797-0002-4048-8521-2f55230629c6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:15.067826 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccc797-0002-4048-8521-2f55230629c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:15.068672 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccc797-0002-4048-8521-2f55230629c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:15.100421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccc797-0002-4048-8521-2f55230629c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:15.104691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccc797-0002-4048-8521-2f55230629c6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:15.115884 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72a99b0-1802-4b90-a987-9155b20f11ea None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-1bccc797-0002-4048-8521-2f55230629c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:15.148812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:15.151144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:15.152816 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:15.152816 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:15.152816 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:15.152816 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:15.154172 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 295/598] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:15.159107 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccc797-0002-4048-8521-2f55230629c6 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:15.190830 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f94a67-82e4-44d8-a865-3cbba530a56d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:15.193495 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f94a67-82e4-44d8-a865-3cbba530a56d None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:15.194340 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f94a67-82e4-44d8-a865-3cbba530a56d None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:15.195389 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f94a67-82e4-44d8-a865-3cbba530a56d None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:15.198226 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f94a67-82e4-44d8-a865-3cbba530a56d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:15.199105 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f94a67-82e4-44d8-a865-3cbba530a56d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:15.201975 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f94a67-82e4-44d8-a865-3cbba530a56d None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:15.238587 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 304/599] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:15.249786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f94a67-82e4-44d8-a865-3cbba530a56d None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:15.271310 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:15.300773 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccc797-0002-4048-8521-2f55230629c6 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:15.339793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adea025-e26c-4315-b9c4-048369ac83aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:15.340511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adea025-e26c-4315-b9c4-048369ac83aa None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:15.340845 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adea025-e26c-4315-b9c4-048369ac83aa None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:15.341168 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adea025-e26c-4315-b9c4-048369ac83aa None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:15.341904 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adea025-e26c-4315-b9c4-048369ac83aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:15.342333 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adea025-e26c-4315-b9c4-048369ac83aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:15.343713 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1adea025-e26c-4315-b9c4-048369ac83aa None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:15.357943 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 296/600] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:15.366046 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adea025-e26c-4315-b9c4-048369ac83aa None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:15.398989 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:15.465746 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f94a67-82e4-44d8-a865-3cbba530a56d None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:15.536890 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc2dd4-4626-4923-a135-28c7063c00fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:15.538594 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc2dd4-4626-4923-a135-28c7063c00fe None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:15.539306 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc2dd4-4626-4923-a135-28c7063c00fe None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:15.540005 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbc2dd4-4626-4923-a135-28c7063c00fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:15.540298 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1adea025-e26c-4315-b9c4-048369ac83aa None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:15.554132 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc2dd4-4626-4923-a135-28c7063c00fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:15.557963 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbc2dd4-4626-4923-a135-28c7063c00fe None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-dfbc2dd4-4626-4923-a135-28c7063c00fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:15.588037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:15.589960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:15.591773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:15.591773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:15.591773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:15.591773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:15.591773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:15.591773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:15.591773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:15.591773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:15.596624 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 305/601] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:15.605561 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc2dd4-4626-4923-a135-28c7063c00fe None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:15.613039 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93e723-e11d-4e3c-b171-2ae2c3ebd2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:15.615029 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e723-e11d-4e3c-b171-2ae2c3ebd2ec None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:15.615029 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e723-e11d-4e3c-b171-2ae2c3ebd2ec None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:15.615327 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93e723-e11d-4e3c-b171-2ae2c3ebd2ec None admin] PATH_INFO: `/v3/users/nova` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:15.629825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93e723-e11d-4e3c-b171-2ae2c3ebd2ec None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:15.632614 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93e723-e11d-4e3c-b171-2ae2c3ebd2ec None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-cf93e723-e11d-4e3c-b171-2ae2c3ebd2ec None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:15.661550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:15.663491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:15.665421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:15.665421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:15.665421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:15.665421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:15.665421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:15.665421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:15.665421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:15.665421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:15.665421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:57:15.665421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:15.665421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 297/602] 10.222.0.25 () {56 vars in 1093 bytes} [Wed May 25 07:57:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:15.670230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93e723-e11d-4e3c-b171-2ae2c3ebd2ec None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:15.727342 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:15.769214 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbc2dd4-4626-4923-a135-28c7063c00fe None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:15.832570 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:15.855969 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46bf0b-def2-4d9a-b058-d664000bdde8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:15.856695 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46bf0b-def2-4d9a-b058-d664000bdde8 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:15.856981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46bf0b-def2-4d9a-b058-d664000bdde8 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:15.857259 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb46bf0b-def2-4d9a-b058-d664000bdde8 None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:15.858052 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46bf0b-def2-4d9a-b058-d664000bdde8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:15.858360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46bf0b-def2-4d9a-b058-d664000bdde8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:15.859817 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb46bf0b-def2-4d9a-b058-d664000bdde8 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:15.880360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 306/603] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:15.881484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93e723-e11d-4e3c-b171-2ae2c3ebd2ec None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:15.888816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46bf0b-def2-4d9a-b058-d664000bdde8 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:15.953446 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9450e-d34f-40be-be10-46fe902a6b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:15.954143 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9450e-d34f-40be-be10-46fe902a6b37 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:15.954434 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9450e-d34f-40be-be10-46fe902a6b37 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:15.954867 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e9450e-d34f-40be-be10-46fe902a6b37 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:15.955906 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9450e-d34f-40be-be10-46fe902a6b37 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:15.956257 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9450e-d34f-40be-be10-46fe902a6b37 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:15.957728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e9450e-d34f-40be-be10-46fe902a6b37 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:15.987138 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 298/604] 10.222.0.25 () {56 vars in 1133 bytes} [Wed May 25 07:57:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:15.998655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9450e-d34f-40be-be10-46fe902a6b37 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:16.069902 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb46bf0b-def2-4d9a-b058-d664000bdde8 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:16.124429 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:16.143364 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72a1b47-02a0-47bc-82b1-ac9c48f0000e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:16.144786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1b47-02a0-47bc-82b1-ac9c48f0000e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:16.145428 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1b47-02a0-47bc-82b1-ac9c48f0000e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:16.146053 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72a1b47-02a0-47bc-82b1-ac9c48f0000e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:16.147879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1b47-02a0-47bc-82b1-ac9c48f0000e None admin] RBAC: Adding query filter params (role.id=032121f695584aebbac76f0f8ca183fa, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=6ca17baadab7473c81d80597fc0fa0f2) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:16.148632 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1b47-02a0-47bc-82b1-ac9c48f0000e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:16.153323 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72a1b47-02a0-47bc-82b1-ac9c48f0000e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:16.172663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 307/605] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:57:15 2022] GET /identity/v3/role_assignments?user.id=6ca17baadab7473c81d80597fc0fa0f2&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=032121f695584aebbac76f0f8ca183fa => generated 608 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:16.217565 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e9450e-d34f-40be-be10-46fe902a6b37 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:16.291741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58af963-265e-4217-8057-8f63e96b021d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:16.293291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58af963-265e-4217-8057-8f63e96b021d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:16.293976 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58af963-265e-4217-8057-8f63e96b021d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:16.294658 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58af963-265e-4217-8057-8f63e96b021d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:16.326725 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:16.448715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58af963-265e-4217-8057-8f63e96b021d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:16.452961 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58af963-265e-4217-8057-8f63e96b021d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:16.613064 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d4e0-4b9d-4335-9d27-b3f805d1e905 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:16.613891 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d4e0-4b9d-4335-9d27-b3f805d1e905 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:16.613891 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37d4e0-4b9d-4335-9d27-b3f805d1e905 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:16.615339 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 308/606] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:57:16.626564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f28706-ef63-475b-87d5-18115883b05a None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:16.627049 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f28706-ef63-475b-87d5-18115883b05a None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:16.628180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f28706-ef63-475b-87d5-18115883b05a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:16.659462 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-04f28706-ef63-475b-87d5-18115883b05a None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:16.661073 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-04f28706-ef63-475b-87d5-18115883b05a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:16.668177 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 299/607] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:57:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:57:16.676938 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58af963-265e-4217-8057-8f63e96b021d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:16.724733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:16.806135 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58af963-265e-4217-8057-8f63e96b021d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:16.811907 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 309/608] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:57:16.835017 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f28706-ef63-475b-87d5-18115883b05a None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:16.889115 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777881cc-0308-42e1-b458-753867dc84db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:16.889970 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777881cc-0308-42e1-b458-753867dc84db None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:16.890522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777881cc-0308-42e1-b458-753867dc84db None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:16.890791 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777881cc-0308-42e1-b458-753867dc84db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:16.909608 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777881cc-0308-42e1-b458-753867dc84db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:16.913973 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777881cc-0308-42e1-b458-753867dc84db None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-777881cc-0308-42e1-b458-753867dc84db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:16.951256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:16.953230 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:16.954912 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:16.954912 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:16.954912 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:16.954912 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:16.960832 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 300/609] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:16.963270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777881cc-0308-42e1-b458-753867dc84db None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:17.065455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f28706-ef63-475b-87d5-18115883b05a None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:17.113738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:17.141558 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfcd847-51bf-43e3-b7d0-563ad7331555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:17.143940 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcd847-51bf-43e3-b7d0-563ad7331555 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:17.144725 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcd847-51bf-43e3-b7d0-563ad7331555 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:17.145444 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfcd847-51bf-43e3-b7d0-563ad7331555 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:17.155432 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:17.170968 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfcd847-51bf-43e3-b7d0-563ad7331555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:17.177068 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777881cc-0308-42e1-b458-753867dc84db None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-1cfcd847-51bf-43e3-b7d0-563ad7331555 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:17.191098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:17.192623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:17.194277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:17.194277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:17.194277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:17.194277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:17.194277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:17.194277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:17.194277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:17.194277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:17.194277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:17.194277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:17.194277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:17.194277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:17.194277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 310/610] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:17.201778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb7bc4-52f0-4c87-97b9-ae3dcd7b99c9 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:17.202134 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb7bc4-52f0-4c87-97b9-ae3dcd7b99c9 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:17.202438 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeb7bc4-52f0-4c87-97b9-ae3dcd7b99c9 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:17.204043 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 311/611] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:57:17.209420 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb7bc4-52f0-4c87-97b9-ae3dcd7b99c9 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:17.234551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91e5032-11cc-496e-880f-bc0a5a9854ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:17.235260 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e5032-11cc-496e-880f-bc0a5a9854ea None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:17.235547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e5032-11cc-496e-880f-bc0a5a9854ea None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:17.235867 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91e5032-11cc-496e-880f-bc0a5a9854ea None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:17.236635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e5032-11cc-496e-880f-bc0a5a9854ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:17.236980 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e5032-11cc-496e-880f-bc0a5a9854ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:17.238907 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91e5032-11cc-496e-880f-bc0a5a9854ea None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:17.254208 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 301/612] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:17.255776 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca2341-7cb4-4ac6-82fc-028c90bb8196 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:17.256077 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca2341-7cb4-4ac6-82fc-028c90bb8196 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:17.256397 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bca2341-7cb4-4ac6-82fc-028c90bb8196 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:17.278469 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-4bca2341-7cb4-4ac6-82fc-028c90bb8196 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:17.280731 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-4bca2341-7cb4-4ac6-82fc-028c90bb8196 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:17.370233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 302/613] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:57:17.371109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca2341-7cb4-4ac6-82fc-028c90bb8196 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:17.414290 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeb7bc4-52f0-4c87-97b9-ae3dcd7b99c9 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:17.460649 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18d760-d407-4660-9bc3-492b40c5a59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:17.461598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18d760-d407-4660-9bc3-492b40c5a59c None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:17.462034 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18d760-d407-4660-9bc3-492b40c5a59c None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:17.462483 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18d760-d407-4660-9bc3-492b40c5a59c None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:17.463505 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18d760-d407-4660-9bc3-492b40c5a59c None admin] RBAC: Adding query filter params (name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:17.463964 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18d760-d407-4660-9bc3-492b40c5a59c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:17.465561 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18d760-d407-4660-9bc3-492b40c5a59c None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:17.476462 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 312/614] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:57:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:17.477837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18d760-d407-4660-9bc3-492b40c5a59c None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:17.493247 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:17.518955 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bca2341-7cb4-4ac6-82fc-028c90bb8196 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:17.543854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:17.561448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625ffcb-9920-4658-af61-9321e4c3d186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:17.562572 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625ffcb-9920-4658-af61-9321e4c3d186 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:17.563004 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625ffcb-9920-4658-af61-9321e4c3d186 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:17.563431 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625ffcb-9920-4658-af61-9321e4c3d186 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:17.571186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625ffcb-9920-4658-af61-9321e4c3d186 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:17.572721 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8625ffcb-9920-4658-af61-9321e4c3d186 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-8625ffcb-9920-4658-af61-9321e4c3d186 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:17.588551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:17.590268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:17.592035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:17.592035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:17.592035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:17.592035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:17.592035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:17.592035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:17.592035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:17.592035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:17.592035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 303/615] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:17.592035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625ffcb-9920-4658-af61-9321e4c3d186 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:17.647015 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18d760-d407-4660-9bc3-492b40c5a59c None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:17.701437 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984cf8b-1ec0-41de-8815-ea478bdc0cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:17.702300 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984cf8b-1ec0-41de-8815-ea478bdc0cd7 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:17.702590 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984cf8b-1ec0-41de-8815-ea478bdc0cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:17.702891 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d984cf8b-1ec0-41de-8815-ea478bdc0cd7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:17.715684 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d984cf8b-1ec0-41de-8815-ea478bdc0cd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-d984cf8b-1ec0-41de-8815-ea478bdc0cd7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:17.723653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:17.724919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:17.725766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:17.725766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:17.725766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:17.725766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:17.725766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:17.725766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:17.725766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:17.725766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:17.725766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:17.725766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:17.725766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:57:17.725766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:17.725766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 313/616] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:17.726463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984cf8b-1ec0-41de-8815-ea478bdc0cd7 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:17.740512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8625ffcb-9920-4658-af61-9321e4c3d186 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:17.794064 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1bd10-d687-4a42-acd9-ac68e54300df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:17.794878 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1bd10-d687-4a42-acd9-ac68e54300df None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:17.795159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1bd10-d687-4a42-acd9-ac68e54300df None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:17.795440 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb1bd10-d687-4a42-acd9-ac68e54300df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:17.806144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:17.809749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1bd10-d687-4a42-acd9-ac68e54300df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:17.811996 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb1bd10-d687-4a42-acd9-ac68e54300df None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-bfb1bd10-d687-4a42-acd9-ac68e54300df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:17.832787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:17.834229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:17.835585 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:17.835585 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:17.835585 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:17.835585 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:17.839023 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 304/617] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:17.840033 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1bd10-d687-4a42-acd9-ac68e54300df None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:17.922666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d984cf8b-1ec0-41de-8815-ea478bdc0cd7 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:17.927404 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:17.974018 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c48f28-48e6-4a92-bfc4-f5c0a7f8e5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:17.974808 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c48f28-48e6-4a92-bfc4-f5c0a7f8e5c6 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:17.975168 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c48f28-48e6-4a92-bfc4-f5c0a7f8e5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:17.975533 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c48f28-48e6-4a92-bfc4-f5c0a7f8e5c6 None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:17.976491 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c48f28-48e6-4a92-bfc4-f5c0a7f8e5c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:17.976823 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c48f28-48e6-4a92-bfc4-f5c0a7f8e5c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:17.978900 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c48f28-48e6-4a92-bfc4-f5c0a7f8e5c6 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:18.000187 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 314/618] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:18.000187 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c48f28-48e6-4a92-bfc4-f5c0a7f8e5c6 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:18.000607 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb1bd10-d687-4a42-acd9-ac68e54300df None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:18.065675 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1f1d7-4afa-49f5-b563-aacc9f5a4ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:18.066415 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1f1d7-4afa-49f5-b563-aacc9f5a4ea3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:18.066701 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1f1d7-4afa-49f5-b563-aacc9f5a4ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:18.066981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b1f1d7-4afa-49f5-b563-aacc9f5a4ea3 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:18.067751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1f1d7-4afa-49f5-b563-aacc9f5a4ea3 None admin] RBAC: Adding query filter params (name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:18.068057 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1f1d7-4afa-49f5-b563-aacc9f5a4ea3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:18.069615 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b1f1d7-4afa-49f5-b563-aacc9f5a4ea3 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:18.088297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 305/619] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:57:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:18.088297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1f1d7-4afa-49f5-b563-aacc9f5a4ea3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:18.154390 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:18.185602 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c48f28-48e6-4a92-bfc4-f5c0a7f8e5c6 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:18.212037 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b1f1d7-4afa-49f5-b563-aacc9f5a4ea3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:18.254083 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9afba-2d54-4623-abc5-f4506cc85387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:18.255343 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9afba-2d54-4623-abc5-f4506cc85387 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:18.255873 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9afba-2d54-4623-abc5-f4506cc85387 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:18.256486 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9afba-2d54-4623-abc5-f4506cc85387 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:18.257770 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9afba-2d54-4623-abc5-f4506cc85387 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:18.258380 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9afba-2d54-4623-abc5-f4506cc85387 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:18.261176 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9afba-2d54-4623-abc5-f4506cc85387 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:18.273914 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df378542-c442-4084-9ff4-ed58cb6ac7ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:18.275796 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df378542-c442-4084-9ff4-ed58cb6ac7ce None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:18.276302 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df378542-c442-4084-9ff4-ed58cb6ac7ce None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:18.276766 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df378542-c442-4084-9ff4-ed58cb6ac7ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:18.278933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df378542-c442-4084-9ff4-ed58cb6ac7ce None admin] RBAC: Adding query filter params (role.id=032121f695584aebbac76f0f8ca183fa, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=0b9bc11432e04e779fffd35473e6fbfa) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:18.279612 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df378542-c442-4084-9ff4-ed58cb6ac7ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:18.281963 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df378542-c442-4084-9ff4-ed58cb6ac7ce None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:18.283550 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 315/620] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:18.289601 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9afba-2d54-4623-abc5-f4506cc85387 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:18.304675 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 306/621] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:57:18 2022] GET /identity/v3/role_assignments?user.id=0b9bc11432e04e779fffd35473e6fbfa&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=032121f695584aebbac76f0f8ca183fa => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:18.304675 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df378542-c442-4084-9ff4-ed58cb6ac7ce None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:18.344827 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:18.465162 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df378542-c442-4084-9ff4-ed58cb6ac7ce None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:18.490862 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:18.498939 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9afba-2d54-4623-abc5-f4506cc85387 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:18.516734 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51d8cc-651a-4493-9ee5-cae210901ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:18.519270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51d8cc-651a-4493-9ee5-cae210901ad3 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:18.519857 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51d8cc-651a-4493-9ee5-cae210901ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:18.520382 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51d8cc-651a-4493-9ee5-cae210901ad3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:18.532705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51d8cc-651a-4493-9ee5-cae210901ad3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:18.534229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51d8cc-651a-4493-9ee5-cae210901ad3 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-4e51d8cc-651a-4493-9ee5-cae210901ad3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:18.553328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:18.561377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:18.563045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:18.563045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:18.563045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:18.563045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:18.563045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:18.563045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:18.563045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:18.563045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:18.563045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 25 07:57:18.563045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:18.563045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 307/622] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:57:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:18.568815 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51d8cc-651a-4493-9ee5-cae210901ad3 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:18.593461 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2489e7-d00e-4a30-a2af-d3f744857d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:18.596509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2489e7-d00e-4a30-a2af-d3f744857d6c None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:18.597470 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2489e7-d00e-4a30-a2af-d3f744857d6c None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:18.598337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2489e7-d00e-4a30-a2af-d3f744857d6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:18.622633 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2489e7-d00e-4a30-a2af-d3f744857d6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:18.624244 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2489e7-d00e-4a30-a2af-d3f744857d6c None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-7b2489e7-d00e-4a30-a2af-d3f744857d6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:18.656357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:18.657731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:18.658831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:18.658831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:18.658831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:18.658831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:18.658831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 316/623] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:18.666871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2489e7-d00e-4a30-a2af-d3f744857d6c None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:18.736812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51d8cc-651a-4493-9ee5-cae210901ad3 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:18.788890 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:18.813847 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8dacb-b443-44f3-b11d-4f930c152337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:18.815327 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8dacb-b443-44f3-b11d-4f930c152337 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:18.816017 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8dacb-b443-44f3-b11d-4f930c152337 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:18.816519 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b8dacb-b443-44f3-b11d-4f930c152337 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:18.818933 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8dacb-b443-44f3-b11d-4f930c152337 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:18.819473 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8dacb-b443-44f3-b11d-4f930c152337 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:18.819987 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2489e7-d00e-4a30-a2af-d3f744857d6c None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:18.823037 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b8dacb-b443-44f3-b11d-4f930c152337 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:18.863331 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba84c38-c4c1-4cdc-970a-e8f1ed44af27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:18.864219 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba84c38-c4c1-4cdc-970a-e8f1ed44af27 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:18.864654 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba84c38-c4c1-4cdc-970a-e8f1ed44af27 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:18.865000 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba84c38-c4c1-4cdc-970a-e8f1ed44af27 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:18.865852 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba84c38-c4c1-4cdc-970a-e8f1ed44af27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:18.866298 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba84c38-c4c1-4cdc-970a-e8f1ed44af27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:18.867823 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba84c38-c4c1-4cdc-970a-e8f1ed44af27 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:18.876852 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 308/624] 10.222.0.25 () {56 vars in 1139 bytes} [Wed May 25 07:57:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:18.878135 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8dacb-b443-44f3-b11d-4f930c152337 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:18.890491 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 317/625] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:18.901059 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba84c38-c4c1-4cdc-970a-e8f1ed44af27 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:18.933333 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:19.053840 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b8dacb-b443-44f3-b11d-4f930c152337 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:19.068783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba84c38-c4c1-4cdc-970a-e8f1ed44af27 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:19.102429 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357a3aff-5770-4f4f-8136-514fd88e0030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:19.103459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a3aff-5770-4f4f-8136-514fd88e0030 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:19.103913 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a3aff-5770-4f4f-8136-514fd88e0030 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:19.104402 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357a3aff-5770-4f4f-8136-514fd88e0030 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:19.142207 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7e673a-5b5f-47ee-bed3-34e57e7ee9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:19.143430 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e673a-5b5f-47ee-bed3-34e57e7ee9cd None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:19.143882 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e673a-5b5f-47ee-bed3-34e57e7ee9cd None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:19.144385 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7e673a-5b5f-47ee-bed3-34e57e7ee9cd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:19.150020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:19.161430 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e673a-5b5f-47ee-bed3-34e57e7ee9cd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:19.164010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7e673a-5b5f-47ee-bed3-34e57e7ee9cd None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-1d7e673a-5b5f-47ee-bed3-34e57e7ee9cd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:19.193166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:19.195148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:19.196789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:19.196789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:19.196789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:19.196789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:19.196789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:19.196789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:19.196789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:19.196789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:19.196789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:57:19.196789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:19.196789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 318/626] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:57:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:19.198075 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fcee3-0bfd-47ca-b9b2-366227aa6073 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:19.199219 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fcee3-0bfd-47ca-b9b2-366227aa6073 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:19.199219 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9fcee3-0bfd-47ca-b9b2-366227aa6073 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:19.200757 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 319/627] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:19.201298 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fcee3-0bfd-47ca-b9b2-366227aa6073 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:19.224836 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a3aff-5770-4f4f-8136-514fd88e0030 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:19.227784 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357a3aff-5770-4f4f-8136-514fd88e0030 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:19.275929 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:19.378687 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9fcee3-0bfd-47ca-b9b2-366227aa6073 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:19.388481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 309/628] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:57:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:57:19.391054 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb5801-5d9c-42cc-bad7-dfeb579ff46a None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:19.391476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb5801-5d9c-42cc-bad7-dfeb579ff46a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:19.391752 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bb5801-5d9c-42cc-bad7-dfeb579ff46a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:19.422434 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-90bb5801-5d9c-42cc-bad7-dfeb579ff46a None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:19.424537 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-90bb5801-5d9c-42cc-bad7-dfeb579ff46a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:19.435522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c9703-b9be-453b-a214-b00230e1e025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:19.436741 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c9703-b9be-453b-a214-b00230e1e025 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:19.437255 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c9703-b9be-453b-a214-b00230e1e025 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:19.437762 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c9703-b9be-453b-a214-b00230e1e025 None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:19.439451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c9703-b9be-453b-a214-b00230e1e025 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:19.439983 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c9703-b9be-453b-a214-b00230e1e025 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:19.442851 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c9703-b9be-453b-a214-b00230e1e025 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:19.479082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 320/629] 10.222.0.25 () {56 vars in 1137 bytes} [Wed May 25 07:57:19 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:19.480627 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c9703-b9be-453b-a214-b00230e1e025 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:19.558096 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 310/630] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:57:19.560572 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb5801-5d9c-42cc-bad7-dfeb579ff46a None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:19.590669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:19.675534 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c9703-b9be-453b-a214-b00230e1e025 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:19.683322 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:19.722991 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bb5801-5d9c-42cc-bad7-dfeb579ff46a None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:19.756401 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4590c7-3195-44fe-9a7d-fb58637b0b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:19.757672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4590c7-3195-44fe-9a7d-fb58637b0b64 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:19.758064 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4590c7-3195-44fe-9a7d-fb58637b0b64 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:19.758531 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4590c7-3195-44fe-9a7d-fb58637b0b64 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:19.777621 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4590c7-3195-44fe-9a7d-fb58637b0b64 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:19.779056 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f5cea-f708-4954-9907-e87ab3022190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:19.779987 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4590c7-3195-44fe-9a7d-fb58637b0b64 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:19.780303 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f5cea-f708-4954-9907-e87ab3022190 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:19.780571 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f5cea-f708-4954-9907-e87ab3022190 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:19.780910 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6f5cea-f708-4954-9907-e87ab3022190 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-ff4590c7-3195-44fe-9a7d-fb58637b0b64 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:19.811646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:19.813580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:19.816433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:19.816433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:19.816433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:19.816433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:19.816433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 321/631] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:19.816433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4590c7-3195-44fe-9a7d-fb58637b0b64 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:19.914385 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f5cea-f708-4954-9907-e87ab3022190 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:19.916370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6f5cea-f708-4954-9907-e87ab3022190 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:19.994763 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4590c7-3195-44fe-9a7d-fb58637b0b64 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:20.003937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:20.012103 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:20.061268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 311/632] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:57:20.061268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f5cea-f708-4954-9907-e87ab3022190 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:20.074020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f04e8-b062-4e1e-a88e-cee8da589dec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:20.075587 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f04e8-b062-4e1e-a88e-cee8da589dec None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:20.076097 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f04e8-b062-4e1e-a88e-cee8da589dec None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:20.076634 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98f04e8-b062-4e1e-a88e-cee8da589dec None admin] PATH_INFO: `/v3/services/image` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:20.077932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f04e8-b062-4e1e-a88e-cee8da589dec None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:20.081006 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98f04e8-b062-4e1e-a88e-cee8da589dec None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-b98f04e8-b062-4e1e-a88e-cee8da589dec None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:20.110048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:20.112082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:57:20.113451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:20.118929 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 322/633] 10.222.0.25 () {56 vars in 1105 bytes} [Wed May 25 07:57:19 2022] GET /identity/v3/services/image => generated 86 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:20.118929 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f04e8-b062-4e1e-a88e-cee8da589dec None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:20.235115 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6f5cea-f708-4954-9907-e87ab3022190 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:20.280700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c436cb-03eb-40f3-83ba-d944495b6f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:20.281484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c436cb-03eb-40f3-83ba-d944495b6f1f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:20.281968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c436cb-03eb-40f3-83ba-d944495b6f1f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:20.282346 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c436cb-03eb-40f3-83ba-d944495b6f1f None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:20.283229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c436cb-03eb-40f3-83ba-d944495b6f1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:20.283755 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c436cb-03eb-40f3-83ba-d944495b6f1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:20.285607 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c436cb-03eb-40f3-83ba-d944495b6f1f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:20.289349 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98f04e8-b062-4e1e-a88e-cee8da589dec None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:20.308641 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 312/634] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:20.308641 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c436cb-03eb-40f3-83ba-d944495b6f1f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:20.353598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:20.357322 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85132c-2cd7-42f3-b5ee-d42ea10c2835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:20.358828 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85132c-2cd7-42f3-b5ee-d42ea10c2835 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:20.359329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85132c-2cd7-42f3-b5ee-d42ea10c2835 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:20.359787 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c85132c-2cd7-42f3-b5ee-d42ea10c2835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:20.373943 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85132c-2cd7-42f3-b5ee-d42ea10c2835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:20.375439 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c85132c-2cd7-42f3-b5ee-d42ea10c2835 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-6c85132c-2cd7-42f3-b5ee-d42ea10c2835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:20.395839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:20.397694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:20.399460 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:20.399460 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:20.399460 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:20.399460 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:20.399460 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 323/635] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:20.399460 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85132c-2cd7-42f3-b5ee-d42ea10c2835 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:20.444482 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:20.503513 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c436cb-03eb-40f3-83ba-d944495b6f1f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:20.571864 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c85132c-2cd7-42f3-b5ee-d42ea10c2835 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:20.576287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aeffd-0686-4e10-b80b-e06d7ae6f6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:20.577799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aeffd-0686-4e10-b80b-e06d7ae6f6ef None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:20.579169 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aeffd-0686-4e10-b80b-e06d7ae6f6ef None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:20.579554 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5aeffd-0686-4e10-b80b-e06d7ae6f6ef None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:20.581082 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5aeffd-0686-4e10-b80b-e06d7ae6f6ef None admin] RBAC: Adding query filter params (name=image) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:20.581082 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5aeffd-0686-4e10-b80b-e06d7ae6f6ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:20.583642 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5aeffd-0686-4e10-b80b-e06d7ae6f6ef None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:20.594139 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 313/636] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:20.595093 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aeffd-0686-4e10-b80b-e06d7ae6f6ef None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:20.638296 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cea30-ef91-4f41-9df0-38b4137358b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:20.639113 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cea30-ef91-4f41-9df0-38b4137358b0 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:20.639399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cea30-ef91-4f41-9df0-38b4137358b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:20.639675 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2cea30-ef91-4f41-9df0-38b4137358b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:20.658964 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cea30-ef91-4f41-9df0-38b4137358b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:20.660501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2cea30-ef91-4f41-9df0-38b4137358b0 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-ac2cea30-ef91-4f41-9df0-38b4137358b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:20.688643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:20.691413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:20.693559 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:20.693559 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:20.693559 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:20.693559 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:20.693559 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:20.693559 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:20.693559 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:20.693559 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:20.693559 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 324/637] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:20.694567 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cea30-ef91-4f41-9df0-38b4137358b0 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:20.743013 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:20.759405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5aeffd-0686-4e10-b80b-e06d7ae6f6ef None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:20.801313 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12083b9d-3084-4c3e-acbc-1634cbe0d38c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:20.802058 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12083b9d-3084-4c3e-acbc-1634cbe0d38c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:20.802371 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12083b9d-3084-4c3e-acbc-1634cbe0d38c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:20.802631 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12083b9d-3084-4c3e-acbc-1634cbe0d38c None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:20.803394 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12083b9d-3084-4c3e-acbc-1634cbe0d38c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:20.803682 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12083b9d-3084-4c3e-acbc-1634cbe0d38c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:20.805113 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12083b9d-3084-4c3e-acbc-1634cbe0d38c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:20.823895 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 314/638] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:20.823895 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12083b9d-3084-4c3e-acbc-1634cbe0d38c None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:20.835252 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:20.866459 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2cea30-ef91-4f41-9df0-38b4137358b0 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:20.924680 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7101dc-1fdb-4110-8131-76b6334d1ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:20.925450 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7101dc-1fdb-4110-8131-76b6334d1ef2 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:20.925927 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7101dc-1fdb-4110-8131-76b6334d1ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:20.926213 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7101dc-1fdb-4110-8131-76b6334d1ef2 None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:20.926934 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7101dc-1fdb-4110-8131-76b6334d1ef2 None admin] RBAC: Adding query filter params (type=image) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:20.927754 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7101dc-1fdb-4110-8131-76b6334d1ef2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:20.929501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb7101dc-1fdb-4110-8131-76b6334d1ef2 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:20.937924 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 325/639] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:20 2022] GET /identity/v3/services?type=image => generated 122 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:20.938757 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7101dc-1fdb-4110-8131-76b6334d1ef2 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:21.004356 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12083b9d-3084-4c3e-acbc-1634cbe0d38c None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:21.058764 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2f79-2847-4a93-bec0-51849a609f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:21.060520 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2f79-2847-4a93-bec0-51849a609f48 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:21.061580 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2f79-2847-4a93-bec0-51849a609f48 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:21.062952 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba2f79-2847-4a93-bec0-51849a609f48 None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:21.065285 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba2f79-2847-4a93-bec0-51849a609f48 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:21.066904 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba2f79-2847-4a93-bec0-51849a609f48 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:21.069487 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ba2f79-2847-4a93-bec0-51849a609f48 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:21.095129 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 315/640] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:21.096431 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2f79-2847-4a93-bec0-51849a609f48 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:21.114844 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:21.155644 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7101dc-1fdb-4110-8131-76b6334d1ef2 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:21.218000 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46bef8e-c782-4ad1-a6d7-13a955af0b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:21.218809 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bef8e-c782-4ad1-a6d7-13a955af0b79 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:21.219326 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bef8e-c782-4ad1-a6d7-13a955af0b79 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:21.219474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46bef8e-c782-4ad1-a6d7-13a955af0b79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:21.227887 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bef8e-c782-4ad1-a6d7-13a955af0b79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:21.231082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46bef8e-c782-4ad1-a6d7-13a955af0b79 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:21.243758 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba2f79-2847-4a93-bec0-51849a609f48 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-f46bef8e-c782-4ad1-a6d7-13a955af0b79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:21.245892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:21.247640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:21.249976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:21.249976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:21.249976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:21.249976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:21.249976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:21.249976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:21.249976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:21.249976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:21.251911 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 326/641] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:21.253442 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b2229-0b26-452b-b0a3-2e2bc312bcbd None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:21.253734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b2229-0b26-452b-b0a3-2e2bc312bcbd None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:21.253995 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b2229-0b26-452b-b0a3-2e2bc312bcbd None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:21.255682 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 327/642] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:21.257393 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b2229-0b26-452b-b0a3-2e2bc312bcbd None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:21.269117 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:21.291424 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd0d2c9-8706-4aed-af0a-ddd28e44c525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:21.292557 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d2c9-8706-4aed-af0a-ddd28e44c525 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:21.292845 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d2c9-8706-4aed-af0a-ddd28e44c525 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:21.293279 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd0d2c9-8706-4aed-af0a-ddd28e44c525 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:21.294129 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d2c9-8706-4aed-af0a-ddd28e44c525 None admin] RBAC: Adding query filter params (role.id=032121f695584aebbac76f0f8ca183fa, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=e0eaeb03cb5f487f9640938b244fe210) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:21.294637 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d2c9-8706-4aed-af0a-ddd28e44c525 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:21.295982 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd0d2c9-8706-4aed-af0a-ddd28e44c525 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:21.309596 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 316/643] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:57:21 2022] GET /identity/v3/role_assignments?user.id=e0eaeb03cb5f487f9640938b244fe210&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=032121f695584aebbac76f0f8ca183fa => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:21.309596 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd72b-ee6c-4bab-9803-e6bb8fd4b78a None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:21.309596 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd72b-ee6c-4bab-9803-e6bb8fd4b78a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:21.309596 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bebd72b-ee6c-4bab-9803-e6bb8fd4b78a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:21.323978 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-2bebd72b-ee6c-4bab-9803-e6bb8fd4b78a None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:21.325504 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-2bebd72b-ee6c-4bab-9803-e6bb8fd4b78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:21.417061 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 317/644] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:57:21.423751 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b2229-0b26-452b-b0a3-2e2bc312bcbd None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:21.446378 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebd72b-ee6c-4bab-9803-e6bb8fd4b78a None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:21.450073 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:21.490202 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28704c87-863d-4c43-a375-0db3c9c10f77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:21.491745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28704c87-863d-4c43-a375-0db3c9c10f77 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:21.492496 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28704c87-863d-4c43-a375-0db3c9c10f77 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:21.493166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28704c87-863d-4c43-a375-0db3c9c10f77 None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:21.494839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28704c87-863d-4c43-a375-0db3c9c10f77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:21.495759 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28704c87-863d-4c43-a375-0db3c9c10f77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:21.498838 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28704c87-863d-4c43-a375-0db3c9c10f77 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:21.531943 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 328/645] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:21.533825 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28704c87-863d-4c43-a375-0db3c9c10f77 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:21.583385 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bebd72b-ee6c-4bab-9803-e6bb8fd4b78a None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:21.641409 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c557d5c-4c61-4a72-800e-7b583aa682b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:21.642036 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557d5c-4c61-4a72-800e-7b583aa682b8 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:21.642321 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557d5c-4c61-4a72-800e-7b583aa682b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:21.642713 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c557d5c-4c61-4a72-800e-7b583aa682b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:21.652102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:21.657030 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c557d5c-4c61-4a72-800e-7b583aa682b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-5c557d5c-4c61-4a72-800e-7b583aa682b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:21.666025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:21.667801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:21.669370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:21.669370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:21.669370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:21.669370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:21.669370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:21.669370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:21.669370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:21.669370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:21.669370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:21.669370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:21.669370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:57:21.669370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:21.669370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 318/646] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:57:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:21.677813 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c557d5c-4c61-4a72-800e-7b583aa682b8 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:21.730445 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28704c87-863d-4c43-a375-0db3c9c10f77 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:21.785823 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:21.794278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d40f4-3571-4305-b36d-c9a616620d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:21.795164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d40f4-3571-4305-b36d-c9a616620d65 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:21.795551 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d40f4-3571-4305-b36d-c9a616620d65 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:21.795930 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8d40f4-3571-4305-b36d-c9a616620d65 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:21.796954 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d40f4-3571-4305-b36d-c9a616620d65 None admin] RBAC: Adding query filter params (role.id=032121f695584aebbac76f0f8ca183fa, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=051dfda2a77e4648ae1f5ee47296499d) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:21.797382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d40f4-3571-4305-b36d-c9a616620d65 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:21.798948 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c8d40f4-3571-4305-b36d-c9a616620d65 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:21.812162 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 329/647] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:57:21 2022] GET /identity/v3/role_assignments?user.id=051dfda2a77e4648ae1f5ee47296499d&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=032121f695584aebbac76f0f8ca183fa => generated 608 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:21.858499 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c557d5c-4c61-4a72-800e-7b583aa682b8 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:21.911928 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca02c0-882d-41de-bb88-c1ed30b7bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:21.913176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca02c0-882d-41de-bb88-c1ed30b7bbec None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:21.913694 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca02c0-882d-41de-bb88-c1ed30b7bbec None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:21.914189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cca02c0-882d-41de-bb88-c1ed30b7bbec None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:21.915275 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca02c0-882d-41de-bb88-c1ed30b7bbec None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:21.915875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca02c0-882d-41de-bb88-c1ed30b7bbec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:21.917710 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cca02c0-882d-41de-bb88-c1ed30b7bbec None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:21.934208 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 319/648] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:57:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:21.942761 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d40f4-3571-4305-b36d-c9a616620d65 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:22.114458 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c8d40f4-3571-4305-b36d-c9a616620d65 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:22.152939 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:22.162010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d452fa6-d93a-4dd4-b8f6-252e46e48c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:22.163053 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d452fa6-d93a-4dd4-b8f6-252e46e48c95 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:22.163438 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d452fa6-d93a-4dd4-b8f6-252e46e48c95 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:22.163910 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d452fa6-d93a-4dd4-b8f6-252e46e48c95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:22.177853 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d452fa6-d93a-4dd4-b8f6-252e46e48c95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:22.179348 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d452fa6-d93a-4dd4-b8f6-252e46e48c95 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-4d452fa6-d93a-4dd4-b8f6-252e46e48c95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:22.201733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:22.202663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:22.203573 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:22.203573 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:22.203573 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:22.203573 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:22.204469 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 330/649] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:22.213769 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca02c0-882d-41de-bb88-c1ed30b7bbec None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:22.410250 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cca02c0-882d-41de-bb88-c1ed30b7bbec None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:22.456703 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:22.471111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44974682-0aed-44c9-b323-260acf1a6e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:22.472307 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974682-0aed-44c9-b323-260acf1a6e5e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:22.472817 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974682-0aed-44c9-b323-260acf1a6e5e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:22.473337 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44974682-0aed-44c9-b323-260acf1a6e5e None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:22.474634 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44974682-0aed-44c9-b323-260acf1a6e5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:22.475197 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44974682-0aed-44c9-b323-260acf1a6e5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:22.477866 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44974682-0aed-44c9-b323-260acf1a6e5e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:22.500469 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 320/650] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:22.505977 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d452fa6-d93a-4dd4-b8f6-252e46e48c95 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:22.663035 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d452fa6-d93a-4dd4-b8f6-252e46e48c95 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:22.727745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934323dc-6eca-45ba-8cc0-41703821a266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:22.729192 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934323dc-6eca-45ba-8cc0-41703821a266 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:22.729461 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934323dc-6eca-45ba-8cc0-41703821a266 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:22.729745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934323dc-6eca-45ba-8cc0-41703821a266 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:22.738791 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934323dc-6eca-45ba-8cc0-41703821a266 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:22.740281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934323dc-6eca-45ba-8cc0-41703821a266 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-934323dc-6eca-45ba-8cc0-41703821a266 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:22.755871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:22.756947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:22.759672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:22.759672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:22.759672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:22.759672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:22.759672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:22.759672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:22.759672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:22.759672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:22.759672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:57:22.759672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:22.759672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 331/651] 10.222.0.25 () {56 vars in 1093 bytes} [Wed May 25 07:57:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:22.769522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44974682-0aed-44c9-b323-260acf1a6e5e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:22.930487 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44974682-0aed-44c9-b323-260acf1a6e5e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:22.977907 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28fb14-c19e-4f6b-a44b-2098ceecce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:22.980270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28fb14-c19e-4f6b-a44b-2098ceecce52 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:22.980974 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28fb14-c19e-4f6b-a44b-2098ceecce52 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:22.981726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28fb14-c19e-4f6b-a44b-2098ceecce52 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:22.983633 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28fb14-c19e-4f6b-a44b-2098ceecce52 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:22.984597 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28fb14-c19e-4f6b-a44b-2098ceecce52 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:22.987811 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28fb14-c19e-4f6b-a44b-2098ceecce52 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:23.023140 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 321/652] 10.222.0.25 () {56 vars in 1133 bytes} [Wed May 25 07:57:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:23.032890 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934323dc-6eca-45ba-8cc0-41703821a266 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:23.080686 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:23.168972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934323dc-6eca-45ba-8cc0-41703821a266 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:23.218183 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b42c75-6273-467b-9295-2629548f499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:23.218867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b42c75-6273-467b-9295-2629548f499c None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:23.219151 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b42c75-6273-467b-9295-2629548f499c None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:23.219433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b42c75-6273-467b-9295-2629548f499c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:23.302843 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b42c75-6273-467b-9295-2629548f499c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:23.304253 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b42c75-6273-467b-9295-2629548f499c None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:23.357691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:23.438393 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 332/653] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:57:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 25 07:57:23.448959 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28fb14-c19e-4f6b-a44b-2098ceecce52 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:23.542120 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:23.646952 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28fb14-c19e-4f6b-a44b-2098ceecce52 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:23.699097 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e93ddb-d373-4fd5-8dcf-ffca6e6e8cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:23.700464 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e93ddb-d373-4fd5-8dcf-ffca6e6e8cec None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:23.700990 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e93ddb-d373-4fd5-8dcf-ffca6e6e8cec None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:23.701455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e93ddb-d373-4fd5-8dcf-ffca6e6e8cec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:23.721956 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e93ddb-d373-4fd5-8dcf-ffca6e6e8cec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:23.724672 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e93ddb-d373-4fd5-8dcf-ffca6e6e8cec None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-b1e93ddb-d373-4fd5-8dcf-ffca6e6e8cec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:23.759700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:23.761540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:23.762855 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:23.762855 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:23.762855 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:23.762855 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:23.762855 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 322/654] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:23.772948 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b42c75-6273-467b-9295-2629548f499c None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:23.831428 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6cf25-c4ee-4359-9696-de08abee4bf8 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:23.832233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6cf25-c4ee-4359-9696-de08abee4bf8 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:23.832374 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6cf25-c4ee-4359-9696-de08abee4bf8 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:23.837000 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 323/655] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:57:23.844850 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927fd91-9d49-400b-a203-ae62c0c81d7d None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:23.845297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927fd91-9d49-400b-a203-ae62c0c81d7d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:23.845772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927fd91-9d49-400b-a203-ae62c0c81d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:23.877050 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-4927fd91-9d49-400b-a203-ae62c0c81d7d None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:23.877050 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-4927fd91-9d49-400b-a203-ae62c0c81d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:24.006627 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b42c75-6273-467b-9295-2629548f499c None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:24.028288 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 324/656] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:57:24.068052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927fd91-9d49-400b-a203-ae62c0c81d7d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:24.080017 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc4da34-3169-420a-851e-fb997aebd5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:24.081148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4da34-3169-420a-851e-fb997aebd5a2 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:24.081633 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4da34-3169-420a-851e-fb997aebd5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:24.082113 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc4da34-3169-420a-851e-fb997aebd5a2 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:24.083419 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4da34-3169-420a-851e-fb997aebd5a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:24.083938 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4da34-3169-420a-851e-fb997aebd5a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:24.086620 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc4da34-3169-420a-851e-fb997aebd5a2 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:24.109898 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 333/657] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:24.112250 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795f685-1523-464b-af31-9fc67ced0257 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:24.112732 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795f685-1523-464b-af31-9fc67ced0257 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:24.113209 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4795f685-1523-464b-af31-9fc67ced0257 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:24.115641 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 334/658] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:24.117028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795f685-1523-464b-af31-9fc67ced0257 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:24.122023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:24.126719 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:24.245543 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927fd91-9d49-400b-a203-ae62c0c81d7d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:24.301665 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4795f685-1523-464b-af31-9fc67ced0257 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:24.306067 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05259f55-f86d-4e06-967e-74fec5e50432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:24.307112 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05259f55-f86d-4e06-967e-74fec5e50432 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:24.307487 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05259f55-f86d-4e06-967e-74fec5e50432 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:24.307895 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05259f55-f86d-4e06-967e-74fec5e50432 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:24.308821 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05259f55-f86d-4e06-967e-74fec5e50432 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:24.310371 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05259f55-f86d-4e06-967e-74fec5e50432 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:24.333571 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 325/659] 10.222.0.25 () {60 vars in 1141 bytes} [Wed May 25 07:57:24 2022] POST /identity/v3/services => generated 242 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:57:24.336313 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19d37c-b295-4b44-baa1-53bb4f125e57 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:24.337169 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19d37c-b295-4b44-baa1-53bb4f125e57 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:24.338540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19d37c-b295-4b44-baa1-53bb4f125e57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:24.366757 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-ba19d37c-b295-4b44-baa1-53bb4f125e57 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:24.369382 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-ba19d37c-b295-4b44-baa1-53bb4f125e57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:24.393219 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbf06e-e6b0-4824-aa7a-f1fae2b1254e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:24.394930 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf06e-e6b0-4824-aa7a-f1fae2b1254e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:24.395423 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf06e-e6b0-4824-aa7a-f1fae2b1254e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:24.395892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbf06e-e6b0-4824-aa7a-f1fae2b1254e None admin] PATH_INFO: `/v3/projects/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:24.413005 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbf06e-e6b0-4824-aa7a-f1fae2b1254e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:24.417159 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbf06e-e6b0-4824-aa7a-f1fae2b1254e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-b1fbf06e-e6b0-4824-aa7a-f1fae2b1254e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:24.447704 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:24.448716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:24.449635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:24.449635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:24.449635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:24.449635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:24.449635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:24.449635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:24.449635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:24.449635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:24.456888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 335/660] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:24.460254 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbf06e-e6b0-4824-aa7a-f1fae2b1254e None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:24.485327 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 326/661] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:24 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:57:24.534954 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19d37c-b295-4b44-baa1-53bb4f125e57 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:24.558613 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:24.576155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:24.666634 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbf06e-e6b0-4824-aa7a-f1fae2b1254e None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:24.708107 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19d37c-b295-4b44-baa1-53bb4f125e57 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:24.730871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66320b33-06f7-4aa8-924a-a2e8c864913f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:24.732310 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66320b33-06f7-4aa8-924a-a2e8c864913f None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:24.732988 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66320b33-06f7-4aa8-924a-a2e8c864913f None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:24.733519 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66320b33-06f7-4aa8-924a-a2e8c864913f None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:24.734666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66320b33-06f7-4aa8-924a-a2e8c864913f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:24.735174 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66320b33-06f7-4aa8-924a-a2e8c864913f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:24.737227 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66320b33-06f7-4aa8-924a-a2e8c864913f None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:24.749305 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2b94a1-2219-4864-9689-2aae299da72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:24.750474 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b94a1-2219-4864-9689-2aae299da72c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:24.750836 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b94a1-2219-4864-9689-2aae299da72c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:24.751114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2b94a1-2219-4864-9689-2aae299da72c None admin] PATH_INFO: `/v3/services/network` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:24.751786 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b94a1-2219-4864-9689-2aae299da72c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:24.753251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2b94a1-2219-4864-9689-2aae299da72c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:24.754226 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 336/662] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:24.756588 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c5dc-1f6a-4fff-9c22-373bcee7ab74 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:24.757324 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c5dc-1f6a-4fff-9c22-373bcee7ab74 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:24.758039 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4808c5dc-1f6a-4fff-9c22-373bcee7ab74 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:24.761255 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 337/663] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:24.762816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808c5dc-1f6a-4fff-9c22-373bcee7ab74 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-9a2b94a1-2219-4864-9689-2aae299da72c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:24.782130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:24.784087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:24.785726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 327/664] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:24 2022] GET /identity/v3/services/network => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:24.794004 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c7ab1-99ef-4d67-b0df-92ab49b36511 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:24.794004 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c7ab1-99ef-4d67-b0df-92ab49b36511 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:24.794004 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87c7ab1-99ef-4d67-b0df-92ab49b36511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:24.817066 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-d87c7ab1-99ef-4d67-b0df-92ab49b36511 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:24.818381 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-d87c7ab1-99ef-4d67-b0df-92ab49b36511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:24.908073 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4808c5dc-1f6a-4fff-9c22-373bcee7ab74 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:24.922807 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 328/665] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:24 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 25 07:57:24.923977 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c7ab1-99ef-4d67-b0df-92ab49b36511 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:24.941155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:24.944426 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:24.974065 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffc603-d768-47ba-8e40-e111092c4515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:24.974747 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffc603-d768-47ba-8e40-e111092c4515 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:24.975062 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffc603-d768-47ba-8e40-e111092c4515 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:24.975343 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffc603-d768-47ba-8e40-e111092c4515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:24.976234 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffc603-d768-47ba-8e40-e111092c4515 None admin] RBAC: Adding query filter params (role.id=5c1382efdc2e4eebaf5f15a4cdae58e0, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=0b9bc11432e04e779fffd35473e6fbfa) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:24.976553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffc603-d768-47ba-8e40-e111092c4515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:24.978581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffc603-d768-47ba-8e40-e111092c4515 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:24.985410 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 338/666] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:57:24 2022] GET /identity/v3/role_assignments?user.id=0b9bc11432e04e779fffd35473e6fbfa&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:24.986270 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffc603-d768-47ba-8e40-e111092c4515 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:25.121922 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87c7ab1-99ef-4d67-b0df-92ab49b36511 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:25.203360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf672ad-6436-4eb8-835b-83cae786cb7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:25.204534 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf672ad-6436-4eb8-835b-83cae786cb7f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:25.205009 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf672ad-6436-4eb8-835b-83cae786cb7f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:25.205482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf672ad-6436-4eb8-835b-83cae786cb7f None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:25.205861 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffc603-d768-47ba-8e40-e111092c4515 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:25.206732 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf672ad-6436-4eb8-835b-83cae786cb7f None admin] RBAC: Adding query filter params (name=network) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:25.207257 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf672ad-6436-4eb8-835b-83cae786cb7f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:25.211008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf672ad-6436-4eb8-835b-83cae786cb7f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:25.228225 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 329/667] 10.222.0.25 () {56 vars in 1112 bytes} [Wed May 25 07:57:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:25.232530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf672ad-6436-4eb8-835b-83cae786cb7f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:25.261328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee97df-424b-4bbe-aaef-4801482b4fa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:25.263109 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee97df-424b-4bbe-aaef-4801482b4fa2 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:25.263842 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee97df-424b-4bbe-aaef-4801482b4fa2 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:25.264554 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ee97df-424b-4bbe-aaef-4801482b4fa2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:25.266298 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee97df-424b-4bbe-aaef-4801482b4fa2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:25.269114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ee97df-424b-4bbe-aaef-4801482b4fa2 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-f5ee97df-424b-4bbe-aaef-4801482b4fa2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:25.295336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:25.297466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:57:25.299317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:25.303881 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 339/668] 10.222.0.25 () {56 vars in 1129 bytes} [Wed May 25 07:57:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:25.315049 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee97df-424b-4bbe-aaef-4801482b4fa2 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:25.333855 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:25.380257 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf672ad-6436-4eb8-835b-83cae786cb7f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:25.387603 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:25.449652 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111da31-4839-41ca-952d-96d5067ed2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:25.450924 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111da31-4839-41ca-952d-96d5067ed2a6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:25.451415 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111da31-4839-41ca-952d-96d5067ed2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:25.452203 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111da31-4839-41ca-952d-96d5067ed2a6 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:25.453514 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111da31-4839-41ca-952d-96d5067ed2a6 None admin] RBAC: Adding query filter params (type=network) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:25.454056 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111da31-4839-41ca-952d-96d5067ed2a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:25.457014 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2111da31-4839-41ca-952d-96d5067ed2a6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:25.464096 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ee97df-424b-4bbe-aaef-4801482b4fa2 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:25.469039 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 330/669] 10.222.0.25 () {56 vars in 1112 bytes} [Wed May 25 07:57:25 2022] GET /identity/v3/services?type=network => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:25.508300 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96011c-6fe9-4c11-bea6-704287f43d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:25.509338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96011c-6fe9-4c11-bea6-704287f43d5a None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:25.509778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96011c-6fe9-4c11-bea6-704287f43d5a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:25.510202 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96011c-6fe9-4c11-bea6-704287f43d5a None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:25.511125 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96011c-6fe9-4c11-bea6-704287f43d5a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:25.511600 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96011c-6fe9-4c11-bea6-704287f43d5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:25.513289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96011c-6fe9-4c11-bea6-704287f43d5a None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:25.519514 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 340/670] 10.222.0.25 () {56 vars in 1124 bytes} [Wed May 25 07:57:25 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:25.528943 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111da31-4839-41ca-952d-96d5067ed2a6 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:25.711601 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111da31-4839-41ca-952d-96d5067ed2a6 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:25.782231 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfa32ad-82cf-450a-84c0-96b3e2e18e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:25.783347 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa32ad-82cf-450a-84c0-96b3e2e18e49 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:25.783817 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa32ad-82cf-450a-84c0-96b3e2e18e49 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:25.784363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfa32ad-82cf-450a-84c0-96b3e2e18e49 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:25.787288 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa32ad-82cf-450a-84c0-96b3e2e18e49 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:25.787288 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa32ad-82cf-450a-84c0-96b3e2e18e49 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:25.788950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dfa32ad-82cf-450a-84c0-96b3e2e18e49 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:25.804262 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 331/671] 10.222.0.25 () {56 vars in 1124 bytes} [Wed May 25 07:57:25 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:27.301809 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153641-1e4b-4aff-958e-169dd69cd8b3 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:27.302723 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153641-1e4b-4aff-958e-169dd69cd8b3 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:27.303183 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03153641-1e4b-4aff-958e-169dd69cd8b3 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:27.305073 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 341/672] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:27.311693 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754cfd4-fa3d-451e-a90d-7cf088fe2fb8 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:27.312641 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754cfd4-fa3d-451e-a90d-7cf088fe2fb8 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:27.313107 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5754cfd4-fa3d-451e-a90d-7cf088fe2fb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:27.318925 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:27.333951 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-5754cfd4-fa3d-451e-a90d-7cf088fe2fb8 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:27.335352 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-5754cfd4-fa3d-451e-a90d-7cf088fe2fb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:27.418564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 332/673] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:27 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:57:27.442593 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03153641-1e4b-4aff-958e-169dd69cd8b3 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:27.568051 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03153641-1e4b-4aff-958e-169dd69cd8b3 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:27.582728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:27.619605 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556b56f-3ed6-470e-af07-1dad3f8fb5d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:27.620470 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556b56f-3ed6-470e-af07-1dad3f8fb5d2 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:27.620755 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556b56f-3ed6-470e-af07-1dad3f8fb5d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:27.621032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b556b56f-3ed6-470e-af07-1dad3f8fb5d2 None admin] PATH_INFO: `/v3/services/image` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:27.621700 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556b56f-3ed6-470e-af07-1dad3f8fb5d2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:27.623129 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b556b56f-3ed6-470e-af07-1dad3f8fb5d2 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-b556b56f-3ed6-470e-af07-1dad3f8fb5d2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:27.636114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:27.638358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:27.640403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 342/674] 10.222.0.25 () {56 vars in 1105 bytes} [Wed May 25 07:57:27 2022] GET /identity/v3/services/image => generated 86 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:27.646298 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754cfd4-fa3d-451e-a90d-7cf088fe2fb8 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:27.855074 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5754cfd4-fa3d-451e-a90d-7cf088fe2fb8 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:27.914945 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:27.923919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803e76a-ccab-4cd0-a5c8-4b83c2ee23ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:27.925128 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803e76a-ccab-4cd0-a5c8-4b83c2ee23ec None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:27.925623 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803e76a-ccab-4cd0-a5c8-4b83c2ee23ec None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:27.926106 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803e76a-ccab-4cd0-a5c8-4b83c2ee23ec None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:27.927477 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803e76a-ccab-4cd0-a5c8-4b83c2ee23ec None admin] RBAC: Adding query filter params (name=image) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:27.928028 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803e76a-ccab-4cd0-a5c8-4b83c2ee23ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:27.930777 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803e76a-ccab-4cd0-a5c8-4b83c2ee23ec None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:27.940286 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 333/675] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:27.945892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556b56f-3ed6-470e-af07-1dad3f8fb5d2 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:28.132666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b556b56f-3ed6-470e-af07-1dad3f8fb5d2 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:28.182594 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb07ed-a112-479e-b528-2e1f9dc5a68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:28.183282 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb07ed-a112-479e-b528-2e1f9dc5a68d None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:28.183567 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb07ed-a112-479e-b528-2e1f9dc5a68d None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:28.183841 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beb07ed-a112-479e-b528-2e1f9dc5a68d None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:28.184586 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb07ed-a112-479e-b528-2e1f9dc5a68d None admin] RBAC: Adding query filter params (type=image) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:28.184892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb07ed-a112-479e-b528-2e1f9dc5a68d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:28.186290 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beb07ed-a112-479e-b528-2e1f9dc5a68d None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:28.192419 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 343/676] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:28.199209 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803e76a-ccab-4cd0-a5c8-4b83c2ee23ec None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:28.355624 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803e76a-ccab-4cd0-a5c8-4b83c2ee23ec None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:28.395273 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6440f183-7d4c-4c81-9f76-05525f923993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:28.395875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f183-7d4c-4c81-9f76-05525f923993 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:28.396190 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f183-7d4c-4c81-9f76-05525f923993 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:28.396646 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6440f183-7d4c-4c81-9f76-05525f923993 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:28.397470 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440f183-7d4c-4c81-9f76-05525f923993 None admin] RBAC: Adding query filter params (interface=public, service_id=d530973146734837a390b7b1bc12d1d0, region_id=RegionOne) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:28.397792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440f183-7d4c-4c81-9f76-05525f923993 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:28.399225 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6440f183-7d4c-4c81-9f76-05525f923993 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:28.409985 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 334/677] 10.222.0.25 () {56 vars in 1251 bytes} [Wed May 25 07:57:28 2022] GET /identity/v3/endpoints?service_id=d530973146734837a390b7b1bc12d1d0&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:28.415163 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb07ed-a112-479e-b528-2e1f9dc5a68d None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:28.460728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:28.519596 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a74282-bb88-4df4-be81-67f76d61e8e3 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:28.519900 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a74282-bb88-4df4-be81-67f76d61e8e3 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:28.520235 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a74282-bb88-4df4-be81-67f76d61e8e3 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:28.521874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 335/678] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:28.527899 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e2b75-aaed-4ce7-8fbe-6d31ad24d6f7 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:28.528316 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e2b75-aaed-4ce7-8fbe-6d31ad24d6f7 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:28.528554 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6e2b75-aaed-4ce7-8fbe-6d31ad24d6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:28.534333 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beb07ed-a112-479e-b528-2e1f9dc5a68d None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:28.547855 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-8b6e2b75-aaed-4ce7-8fbe-6d31ad24d6f7 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:28.549113 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8b6e2b75-aaed-4ce7-8fbe-6d31ad24d6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:28.576045 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719513a3-440e-4db8-a197-03ad6d55623a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:28.576780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719513a3-440e-4db8-a197-03ad6d55623a None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:28.577066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719513a3-440e-4db8-a197-03ad6d55623a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:28.577345 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719513a3-440e-4db8-a197-03ad6d55623a None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:28.578041 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719513a3-440e-4db8-a197-03ad6d55623a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:28.579454 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719513a3-440e-4db8-a197-03ad6d55623a None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:28.592163 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 344/679] 10.222.0.25 () {56 vars in 1087 bytes} [Wed May 25 07:57:28 2022] GET /identity/v3/services => generated 535 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:28.592163 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ff95a-aa1b-40c1-be64-c0d7a89ef741 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:28.592163 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ff95a-aa1b-40c1-be64-c0d7a89ef741 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:28.592163 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2ff95a-aa1b-40c1-be64-c0d7a89ef741 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:28.592163 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 345/680] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:28.594650 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e272e88-ba1e-4c8a-8185-79ee2f75219e None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:28.594954 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e272e88-ba1e-4c8a-8185-79ee2f75219e None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:28.595216 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e272e88-ba1e-4c8a-8185-79ee2f75219e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:28.618343 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-2e272e88-ba1e-4c8a-8185-79ee2f75219e None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:28.619856 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-2e272e88-ba1e-4c8a-8185-79ee2f75219e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:28.664193 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:28.688185 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 336/681] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:28 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:57:28.709398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e2b75-aaed-4ce7-8fbe-6d31ad24d6f7 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:28.744433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 346/682] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:28 2022] POST /identity/v3/auth/tokens => generated 895 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:57:28.768779 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e272e88-ba1e-4c8a-8185-79ee2f75219e None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:28.825303 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:28.868089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6e2b75-aaed-4ce7-8fbe-6d31ad24d6f7 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:28.918778 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690824a-349d-415a-8036-a0dd1c12a157 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:28.920150 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690824a-349d-415a-8036-a0dd1c12a157 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:28.920635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690824a-349d-415a-8036-a0dd1c12a157 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:28.921097 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d690824a-349d-415a-8036-a0dd1c12a157 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:28.934814 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d690824a-349d-415a-8036-a0dd1c12a157 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-d690824a-349d-415a-8036-a0dd1c12a157 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:28.944141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:28.945326 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:28.946435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:28.946435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:28.946435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:28.946435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:28.946435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:28.946435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:28.946435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:28.946435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:28.946435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:28.946435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:28.946435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:57:28.946435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:28.949194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 337/683] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:57:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:28.953047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e272e88-ba1e-4c8a-8185-79ee2f75219e None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:28.955816 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690824a-349d-415a-8036-a0dd1c12a157 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:28.994625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32680d6f-2077-49b8-99f0-0b863e0af531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:28.995360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680d6f-2077-49b8-99f0-0b863e0af531 None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:28.995585 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680d6f-2077-49b8-99f0-0b863e0af531 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:28.995863 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32680d6f-2077-49b8-99f0-0b863e0af531 None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:28.996630 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32680d6f-2077-49b8-99f0-0b863e0af531 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:28.998699 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32680d6f-2077-49b8-99f0-0b863e0af531 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:29.025192 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 347/684] 10.222.0.25 () {60 vars in 1141 bytes} [Wed May 25 07:57:28 2022] POST /identity/v3/services => generated 240 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:57:29.029506 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:29.075813 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09801ce-e5a3-496e-a4ce-36e79a26baf6 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:29.076375 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09801ce-e5a3-496e-a4ce-36e79a26baf6 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:29.076875 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09801ce-e5a3-496e-a4ce-36e79a26baf6 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:29.084151 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 348/685] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:29 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:57:29.086403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be07089-bd0b-44a5-a856-b4c5d201e9de None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:29.086701 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be07089-bd0b-44a5-a856-b4c5d201e9de None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:29.086987 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be07089-bd0b-44a5-a856-b4c5d201e9de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:29.097452 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d690824a-349d-415a-8036-a0dd1c12a157 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:29.108152 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-7be07089-bd0b-44a5-a856-b4c5d201e9de None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:29.110452 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-7be07089-bd0b-44a5-a856-b4c5d201e9de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:29.166687 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427fcb4-c219-4ed4-9d51-5dc4159f4762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:29.167645 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427fcb4-c219-4ed4-9d51-5dc4159f4762 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:29.167941 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427fcb4-c219-4ed4-9d51-5dc4159f4762 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:29.168286 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4427fcb4-c219-4ed4-9d51-5dc4159f4762 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:29.169952 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427fcb4-c219-4ed4-9d51-5dc4159f4762 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:29.169952 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427fcb4-c219-4ed4-9d51-5dc4159f4762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:29.171153 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4427fcb4-c219-4ed4-9d51-5dc4159f4762 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:29.189191 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 338/686] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:57:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:29.192442 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427fcb4-c219-4ed4-9d51-5dc4159f4762 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:29.220275 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 349/687] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:29 2022] POST /identity/v3/auth/tokens => generated 994 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 25 07:57:29.238532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be07089-bd0b-44a5-a856-b4c5d201e9de None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:29.274503 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:29.330942 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4427fcb4-c219-4ed4-9d51-5dc4159f4762 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:29.341571 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:29.373975 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c75ac-e6aa-4170-864f-d31d3b0c7362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:29.374928 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c75ac-e6aa-4170-864f-d31d3b0c7362 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:29.375069 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c75ac-e6aa-4170-864f-d31d3b0c7362 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:29.375431 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14c75ac-e6aa-4170-864f-d31d3b0c7362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:29.388223 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be07089-bd0b-44a5-a856-b4c5d201e9de None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:29.392903 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c75ac-e6aa-4170-864f-d31d3b0c7362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:29.394392 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14c75ac-e6aa-4170-864f-d31d3b0c7362 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-b14c75ac-e6aa-4170-864f-d31d3b0c7362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:29.421015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:29.421919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:29.422812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:29.422812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:29.422812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:29.422812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:29.425603 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 339/688] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:29.431955 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c75ac-e6aa-4170-864f-d31d3b0c7362 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:29.439161 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357787e-377d-4a0f-a983-e676f74b739b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:29.440012 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357787e-377d-4a0f-a983-e676f74b739b None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:29.440426 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357787e-377d-4a0f-a983-e676f74b739b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:29.440805 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357787e-377d-4a0f-a983-e676f74b739b None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:29.441661 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357787e-377d-4a0f-a983-e676f74b739b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:29.443232 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1357787e-377d-4a0f-a983-e676f74b739b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:29.464223 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 350/689] 10.222.0.25 () {60 vars in 1141 bytes} [Wed May 25 07:57:29 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:57:29.580809 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14c75ac-e6aa-4170-864f-d31d3b0c7362 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:29.633664 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c221998-bc0e-4038-ae00-d814dbb52afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:29.634393 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c221998-bc0e-4038-ae00-d814dbb52afe None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:29.634680 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c221998-bc0e-4038-ae00-d814dbb52afe None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:29.634956 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c221998-bc0e-4038-ae00-d814dbb52afe None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:29.635712 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c221998-bc0e-4038-ae00-d814dbb52afe None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:29.636021 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c221998-bc0e-4038-ae00-d814dbb52afe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:29.637536 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c221998-bc0e-4038-ae00-d814dbb52afe None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:29.652985 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 340/690] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:29.658443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357787e-377d-4a0f-a983-e676f74b739b None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:29.756004 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:29.779609 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357787e-377d-4a0f-a983-e676f74b739b None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:29.819381 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3b496-e198-479c-9758-5de2d9bb9027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:29.820590 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3b496-e198-479c-9758-5de2d9bb9027 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:29.821085 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3b496-e198-479c-9758-5de2d9bb9027 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:29.822140 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee3b496-e198-479c-9758-5de2d9bb9027 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:29.831252 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3b496-e198-479c-9758-5de2d9bb9027 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:29.833119 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee3b496-e198-479c-9758-5de2d9bb9027 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-0ee3b496-e198-479c-9758-5de2d9bb9027 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:29.849361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:29.850369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:29.851295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:29.851295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:29.851295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:29.851295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:29.851295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:29.851295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:29.851295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:29.851295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:29.851295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:57:29.851295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:29.854802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 351/691] 10.222.0.25 () {56 vars in 1093 bytes} [Wed May 25 07:57:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:29.864160 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c221998-bc0e-4038-ae00-d814dbb52afe None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:29.908537 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:30.071148 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c221998-bc0e-4038-ae00-d814dbb52afe None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:30.122524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5fd83-561b-4401-a737-58e8a4c5b936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:30.123575 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5fd83-561b-4401-a737-58e8a4c5b936 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:30.124057 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5fd83-561b-4401-a737-58e8a4c5b936 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:30.124584 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a5fd83-561b-4401-a737-58e8a4c5b936 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:30.125642 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5fd83-561b-4401-a737-58e8a4c5b936 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:30.126149 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5fd83-561b-4401-a737-58e8a4c5b936 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:30.127881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a5fd83-561b-4401-a737-58e8a4c5b936 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:30.147642 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 341/692] 10.222.0.25 () {56 vars in 1133 bytes} [Wed May 25 07:57:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:30.156833 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3b496-e198-479c-9758-5de2d9bb9027 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:30.266215 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee3b496-e198-479c-9758-5de2d9bb9027 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:30.304210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cbc81-fe53-463d-a1dd-87313ea547f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:30.305702 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cbc81-fe53-463d-a1dd-87313ea547f9 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:30.306829 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cbc81-fe53-463d-a1dd-87313ea547f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:30.307384 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86cbc81-fe53-463d-a1dd-87313ea547f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:30.319922 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cbc81-fe53-463d-a1dd-87313ea547f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:30.322393 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86cbc81-fe53-463d-a1dd-87313ea547f9 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:30.324717 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-d86cbc81-fe53-463d-a1dd-87313ea547f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:30.343406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:30.344399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:30.345260 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:30.345260 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:30.345260 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:30.345260 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:30.347512 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 352/693] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:30.355930 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5fd83-561b-4401-a737-58e8a4c5b936 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:30.472648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:30.501697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a5fd83-561b-4401-a737-58e8a4c5b936 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:30.538541 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e04ab6-cce9-4c27-afcb-31bdeb51f4b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:30.539671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e04ab6-cce9-4c27-afcb-31bdeb51f4b9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:30.540221 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e04ab6-cce9-4c27-afcb-31bdeb51f4b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:30.540697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e04ab6-cce9-4c27-afcb-31bdeb51f4b9 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:30.541634 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e04ab6-cce9-4c27-afcb-31bdeb51f4b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:30.542163 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e04ab6-cce9-4c27-afcb-31bdeb51f4b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:30.543756 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e04ab6-cce9-4c27-afcb-31bdeb51f4b9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:30.557247 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 342/694] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:30.565801 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cbc81-fe53-463d-a1dd-87313ea547f9 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:30.676575 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86cbc81-fe53-463d-a1dd-87313ea547f9 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:30.715295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78441f82-bc4d-47d2-9d3a-ea9763cead61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:30.716108 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78441f82-bc4d-47d2-9d3a-ea9763cead61 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:30.716425 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78441f82-bc4d-47d2-9d3a-ea9763cead61 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:30.716758 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78441f82-bc4d-47d2-9d3a-ea9763cead61 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:30.724420 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78441f82-bc4d-47d2-9d3a-ea9763cead61 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:30.725888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78441f82-bc4d-47d2-9d3a-ea9763cead61 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-78441f82-bc4d-47d2-9d3a-ea9763cead61 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:30.740962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:30.742981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:30.745407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:30.745407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:30.745407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:30.745407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:30.745407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:30.745407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:30.745407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:30.745407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:30.745407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 353/695] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:30.756952 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e04ab6-cce9-4c27-afcb-31bdeb51f4b9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:30.944693 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e04ab6-cce9-4c27-afcb-31bdeb51f4b9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:31.008594 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7620ce60-cd21-4a08-a766-d14ee9806c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:31.009342 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620ce60-cd21-4a08-a766-d14ee9806c79 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:31.009628 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620ce60-cd21-4a08-a766-d14ee9806c79 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:31.009900 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7620ce60-cd21-4a08-a766-d14ee9806c79 None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:31.010709 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620ce60-cd21-4a08-a766-d14ee9806c79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:31.011017 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620ce60-cd21-4a08-a766-d14ee9806c79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:31.012527 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7620ce60-cd21-4a08-a766-d14ee9806c79 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:31.016479 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:31.044920 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 343/696] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:31.053075 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78441f82-bc4d-47d2-9d3a-ea9763cead61 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:31.166235 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:31.195895 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22843e32-650d-45d9-8539-faeb253de819 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:31.196163 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22843e32-650d-45d9-8539-faeb253de819 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:31.197084 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22843e32-650d-45d9-8539-faeb253de819 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:31.198699 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 344/697] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:57:31.204833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43946c2-13a3-4f35-8348-576e77105148 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:31.205100 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43946c2-13a3-4f35-8348-576e77105148 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:31.205513 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43946c2-13a3-4f35-8348-576e77105148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:31.224330 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-b43946c2-13a3-4f35-8348-576e77105148 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:31.225578 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-b43946c2-13a3-4f35-8348-576e77105148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:31.227092 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78441f82-bc4d-47d2-9d3a-ea9763cead61 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:31.266409 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bcdb4-7957-403c-a103-8f434698999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:31.267317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bcdb4-7957-403c-a103-8f434698999e None admin] REQUEST_METHOD: `PUT` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:31.267641 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bcdb4-7957-403c-a103-8f434698999e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:31.267884 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26bcdb4-7957-403c-a103-8f434698999e None admin] PATH_INFO: `/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/0b9bc11432e04e779fffd35473e6fbfa/roles/5c1382efdc2e4eebaf5f15a4cdae58e0` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:31.270184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bcdb4-7957-403c-a103-8f434698999e None admin] RBAC: Authorizing `identity:create_grant(project_id=b056475a8e394bb3bae06f030dee95ab, user_id=0b9bc11432e04e779fffd35473e6fbfa, role_id=5c1382efdc2e4eebaf5f15a4cdae58e0)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:31.271651 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26bcdb4-7957-403c-a103-8f434698999e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:31.293401 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 354/698] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:57:31 2022] PUT /identity/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/0b9bc11432e04e779fffd35473e6fbfa/roles/5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:57:31.307678 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 345/699] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:57:31.332217 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bcdb4-7957-403c-a103-8f434698999e None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:31.464291 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26bcdb4-7957-403c-a103-8f434698999e None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:31.480779 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:31.505782 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c736929a-98a4-4eec-83ff-8056e6f41344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:31.506646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736929a-98a4-4eec-83ff-8056e6f41344 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:31.506929 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736929a-98a4-4eec-83ff-8056e6f41344 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:31.507256 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c736929a-98a4-4eec-83ff-8056e6f41344 None admin] PATH_INFO: `/v3/services/image` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:31.507922 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736929a-98a4-4eec-83ff-8056e6f41344 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:31.510852 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c736929a-98a4-4eec-83ff-8056e6f41344 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-c736929a-98a4-4eec-83ff-8056e6f41344 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:31.524028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:31.527338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:31.529210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 355/700] 10.222.0.25 () {56 vars in 1105 bytes} [Wed May 25 07:57:31 2022] GET /identity/v3/services/image => generated 86 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:31.533461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43946c2-13a3-4f35-8348-576e77105148 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:31.641100 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9e40c-fe6c-411e-81ee-e784d08b77bf None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:31.641889 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9e40c-fe6c-411e-81ee-e784d08b77bf None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:31.641889 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a9e40c-fe6c-411e-81ee-e784d08b77bf None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:31.643032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 356/701] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:57:31.648842 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7672-1e8e-44cf-8672-1283bc6aa6fa None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:31.649126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7672-1e8e-44cf-8672-1283bc6aa6fa None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:31.649399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf7672-1e8e-44cf-8672-1283bc6aa6fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:31.668022 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43946c2-13a3-4f35-8348-576e77105148 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:31.670223 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-91bf7672-1e8e-44cf-8672-1283bc6aa6fa None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:31.671452 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-91bf7672-1e8e-44cf-8672-1283bc6aa6fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:31.702992 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:31.718960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9e84b-a0ee-453e-9ca0-b556ca5938db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:31.720654 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9e84b-a0ee-453e-9ca0-b556ca5938db None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:31.721134 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9e84b-a0ee-453e-9ca0-b556ca5938db None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:31.721581 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b9e84b-a0ee-453e-9ca0-b556ca5938db None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:31.722962 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9e84b-a0ee-453e-9ca0-b556ca5938db None admin] RBAC: Adding query filter params (name=image) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:31.723924 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9e84b-a0ee-453e-9ca0-b556ca5938db None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:31.725854 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b9e84b-a0ee-453e-9ca0-b556ca5938db None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:31.735301 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 346/702] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:31.741339 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9e84b-a0ee-453e-9ca0-b556ca5938db None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:31.753802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 357/703] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:31 2022] POST /identity/v3/auth/tokens => generated 1098 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:57:31.782246 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf7672-1e8e-44cf-8672-1283bc6aa6fa None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:31.871422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b9e84b-a0ee-453e-9ca0-b556ca5938db None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:31.919683 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505eea6-55a5-449e-b387-2b2db4beb542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:31.920898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505eea6-55a5-449e-b387-2b2db4beb542 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:31.921716 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505eea6-55a5-449e-b387-2b2db4beb542 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:31.922227 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3505eea6-55a5-449e-b387-2b2db4beb542 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:31.923224 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505eea6-55a5-449e-b387-2b2db4beb542 None admin] RBAC: Adding query filter params (type=image) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:31.923758 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505eea6-55a5-449e-b387-2b2db4beb542 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:31.924853 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf7672-1e8e-44cf-8672-1283bc6aa6fa None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:31.925758 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3505eea6-55a5-449e-b387-2b2db4beb542 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:31.937824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 347/704] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:31.938461 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:31.940722 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505eea6-55a5-449e-b387-2b2db4beb542 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:31.972949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90896c67-695a-48fa-bc99-3abc725dfc71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:31.974409 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896c67-695a-48fa-bc99-3abc725dfc71 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:31.974695 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896c67-695a-48fa-bc99-3abc725dfc71 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:31.974972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90896c67-695a-48fa-bc99-3abc725dfc71 None admin] PATH_INFO: `/v3/services/network` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:31.975702 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90896c67-695a-48fa-bc99-3abc725dfc71 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:31.977461 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90896c67-695a-48fa-bc99-3abc725dfc71 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-90896c67-695a-48fa-bc99-3abc725dfc71 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:31.994691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:31.995786 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:31.996780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 358/705] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:31 2022] GET /identity/v3/services/network => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:32.010128 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90896c67-695a-48fa-bc99-3abc725dfc71 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:32.018405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:32.074341 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3505eea6-55a5-449e-b387-2b2db4beb542 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:32.123537 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90fe43-2d2f-4883-bc32-7ce6f7e83fcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:32.124570 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90fe43-2d2f-4883-bc32-7ce6f7e83fcb None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:32.124957 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90fe43-2d2f-4883-bc32-7ce6f7e83fcb None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:32.125332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e90fe43-2d2f-4883-bc32-7ce6f7e83fcb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:32.126712 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90fe43-2d2f-4883-bc32-7ce6f7e83fcb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:32.128594 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e90fe43-2d2f-4883-bc32-7ce6f7e83fcb None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:32.141390 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90896c67-695a-48fa-bc99-3abc725dfc71 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:32.158717 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 348/706] 10.222.0.25 () {60 vars in 1144 bytes} [Wed May 25 07:57:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:57:32.204949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac23666-ca73-45fa-b835-533be933538a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:32.205963 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac23666-ca73-45fa-b835-533be933538a None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:32.206401 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac23666-ca73-45fa-b835-533be933538a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:32.206878 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac23666-ca73-45fa-b835-533be933538a None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:32.207854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac23666-ca73-45fa-b835-533be933538a None admin] RBAC: Adding query filter params (name=network) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:32.208346 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac23666-ca73-45fa-b835-533be933538a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:32.210153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac23666-ca73-45fa-b835-533be933538a None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:32.217893 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 359/707] 10.222.0.25 () {56 vars in 1112 bytes} [Wed May 25 07:57:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:32.225226 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90fe43-2d2f-4883-bc32-7ce6f7e83fcb None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:32.358371 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e90fe43-2d2f-4883-bc32-7ce6f7e83fcb None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:32.369758 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:32.404328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea1378-d0ed-4fa5-a9c2-3406ed56dc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:32.405019 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea1378-d0ed-4fa5-a9c2-3406ed56dc84 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:32.405309 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea1378-d0ed-4fa5-a9c2-3406ed56dc84 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:32.405590 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afea1378-d0ed-4fa5-a9c2-3406ed56dc84 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:32.406411 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea1378-d0ed-4fa5-a9c2-3406ed56dc84 None admin] RBAC: Adding query filter params (type=network) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:32.406728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea1378-d0ed-4fa5-a9c2-3406ed56dc84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:32.408187 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afea1378-d0ed-4fa5-a9c2-3406ed56dc84 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:32.414592 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 349/708] 10.222.0.25 () {56 vars in 1112 bytes} [Wed May 25 07:57:32 2022] GET /identity/v3/services?type=network => generated 350 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:32.421763 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac23666-ca73-45fa-b835-533be933538a None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:32.472671 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:32.604578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac23666-ca73-45fa-b835-533be933538a None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:32.667625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d52db1-e08f-4707-b4c4-5c93df76dea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:32.668796 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d52db1-e08f-4707-b4c4-5c93df76dea1 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:32.669151 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d52db1-e08f-4707-b4c4-5c93df76dea1 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:32.669583 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d52db1-e08f-4707-b4c4-5c93df76dea1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:32.671003 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d52db1-e08f-4707-b4c4-5c93df76dea1 None admin] RBAC: Adding query filter params (interface=public, service_id=7ce1f335a9784c3f9b589db116ebd3b6, region_id=RegionOne) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:32.671501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d52db1-e08f-4707-b4c4-5c93df76dea1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:32.673934 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d52db1-e08f-4707-b4c4-5c93df76dea1 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:32.687927 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 360/709] 10.222.0.25 () {56 vars in 1251 bytes} [Wed May 25 07:57:32 2022] GET /identity/v3/endpoints?service_id=7ce1f335a9784c3f9b589db116ebd3b6&interface=public®ion_id=RegionOne => generated 194 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:32.697187 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea1378-d0ed-4fa5-a9c2-3406ed56dc84 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:32.710305 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87ba87-9476-4d54-9d93-d7c52245e965 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:32.710831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87ba87-9476-4d54-9d93-d7c52245e965 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:32.711246 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87ba87-9476-4d54-9d93-d7c52245e965 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:32.714659 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 361/710] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:57:32.721984 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f13eae-3fc1-4a3e-b257-ad88369ff96e None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:32.722665 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f13eae-3fc1-4a3e-b257-ad88369ff96e None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:32.722938 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f13eae-3fc1-4a3e-b257-ad88369ff96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:32.751964 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-93f13eae-3fc1-4a3e-b257-ad88369ff96e None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:32.753962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-93f13eae-3fc1-4a3e-b257-ad88369ff96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:32.887424 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 362/711] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:32 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:57:32.900994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afea1378-d0ed-4fa5-a9c2-3406ed56dc84 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:32.910843 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f13eae-3fc1-4a3e-b257-ad88369ff96e None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:32.947350 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddf9b8-4295-4a1c-bbff-ff82fce088c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:32.948144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddf9b8-4295-4a1c-bbff-ff82fce088c1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:32.948524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddf9b8-4295-4a1c-bbff-ff82fce088c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:32.948891 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ddf9b8-4295-4a1c-bbff-ff82fce088c1 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:32.949856 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddf9b8-4295-4a1c-bbff-ff82fce088c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:32.951385 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ddf9b8-4295-4a1c-bbff-ff82fce088c1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:32.958683 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 350/712] 10.222.0.25 () {56 vars in 1087 bytes} [Wed May 25 07:57:32 2022] GET /identity/v3/services => generated 1002 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:57:32.978778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:33.140146 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f13eae-3fc1-4a3e-b257-ad88369ff96e None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:33.196186 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038a634-26f8-4f68-86af-3a1acda80e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:33.197443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038a634-26f8-4f68-86af-3a1acda80e4c None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:33.197938 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038a634-26f8-4f68-86af-3a1acda80e4c None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:33.198464 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6038a634-26f8-4f68-86af-3a1acda80e4c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:33.199346 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038a634-26f8-4f68-86af-3a1acda80e4c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:33.200997 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6038a634-26f8-4f68-86af-3a1acda80e4c None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-6038a634-26f8-4f68-86af-3a1acda80e4c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:33.214972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:33.215989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:57:33.216952 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:33.219309 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 363/713] 10.222.0.25 () {56 vars in 1129 bytes} [Wed May 25 07:57:32 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:33.231695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddf9b8-4295-4a1c-bbff-ff82fce088c1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:33.306846 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:33.402923 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ddf9b8-4295-4a1c-bbff-ff82fce088c1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:33.460610 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68625cc-ac1f-46f2-a88c-88694c6a8b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:33.461599 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68625cc-ac1f-46f2-a88c-88694c6a8b63 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:33.462415 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68625cc-ac1f-46f2-a88c-88694c6a8b63 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:33.462702 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68625cc-ac1f-46f2-a88c-88694c6a8b63 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:33.463589 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68625cc-ac1f-46f2-a88c-88694c6a8b63 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:33.463899 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68625cc-ac1f-46f2-a88c-88694c6a8b63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:33.465567 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68625cc-ac1f-46f2-a88c-88694c6a8b63 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:33.472321 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 351/714] 10.222.0.25 () {56 vars in 1124 bytes} [Wed May 25 07:57:33 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:33.479178 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038a634-26f8-4f68-86af-3a1acda80e4c None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:33.583773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:33.595968 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6038a634-26f8-4f68-86af-3a1acda80e4c None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:33.640731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb2603-aca1-4e81-a58a-8ff82a4ba90d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:33.641437 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb2603-aca1-4e81-a58a-8ff82a4ba90d None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:33.641729 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb2603-aca1-4e81-a58a-8ff82a4ba90d None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:33.642011 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bafb2603-aca1-4e81-a58a-8ff82a4ba90d None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:33.642752 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb2603-aca1-4e81-a58a-8ff82a4ba90d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:33.643065 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb2603-aca1-4e81-a58a-8ff82a4ba90d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:33.644557 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bafb2603-aca1-4e81-a58a-8ff82a4ba90d None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:33.651320 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 364/715] 10.222.0.25 () {56 vars in 1124 bytes} [Wed May 25 07:57:33 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:33.657202 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68625cc-ac1f-46f2-a88c-88694c6a8b63 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:33.835977 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:33.846389 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68625cc-ac1f-46f2-a88c-88694c6a8b63 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:33.915988 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06faa53b-edfd-42a8-b767-e76a3970f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:33.917094 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faa53b-edfd-42a8-b767-e76a3970f20c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:33.917959 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faa53b-edfd-42a8-b767-e76a3970f20c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:33.918434 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06faa53b-edfd-42a8-b767-e76a3970f20c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:33.920789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faa53b-edfd-42a8-b767-e76a3970f20c None admin] RBAC: Adding query filter params (interface=public, service_id=92cce9ddc8184e9ab3d8c598a4fb90c7, region_id=RegionOne) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:33.920789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faa53b-edfd-42a8-b767-e76a3970f20c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:33.923105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06faa53b-edfd-42a8-b767-e76a3970f20c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:33.934255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 352/716] 10.222.0.25 () {56 vars in 1251 bytes} [Wed May 25 07:57:33 2022] GET /identity/v3/endpoints?service_id=92cce9ddc8184e9ab3d8c598a4fb90c7&interface=public®ion_id=RegionOne => generated 194 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:33.939278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb2603-aca1-4e81-a58a-8ff82a4ba90d None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:34.018611 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa13d7a-2e8b-4126-8cb5-e9c73f7b4b8d None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:34.019045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa13d7a-2e8b-4126-8cb5-e9c73f7b4b8d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:34.019299 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa13d7a-2e8b-4126-8cb5-e9c73f7b4b8d None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:34.020878 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 353/717] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:57:34.027086 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afad44a-05cf-4f2d-b0b2-9b8ff9786f26 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:34.027480 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afad44a-05cf-4f2d-b0b2-9b8ff9786f26 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:34.027720 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afad44a-05cf-4f2d-b0b2-9b8ff9786f26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:34.046115 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-9afad44a-05cf-4f2d-b0b2-9b8ff9786f26 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:34.047432 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-9afad44a-05cf-4f2d-b0b2-9b8ff9786f26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:34.061002 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bafb2603-aca1-4e81-a58a-8ff82a4ba90d None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:34.105791 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d573ad-1ada-4c46-b190-eb70574c1357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:34.106701 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d573ad-1ada-4c46-b190-eb70574c1357 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:34.107053 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d573ad-1ada-4c46-b190-eb70574c1357 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:34.107395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d573ad-1ada-4c46-b190-eb70574c1357 None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:34.108182 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d573ad-1ada-4c46-b190-eb70574c1357 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:34.109806 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d573ad-1ada-4c46-b190-eb70574c1357 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:34.116553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 365/718] 10.222.0.25 () {56 vars in 1087 bytes} [Wed May 25 07:57:33 2022] GET /identity/v3/services => generated 1002 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:57:34.164806 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 354/719] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:34 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:57:34.212500 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d573ad-1ada-4c46-b190-eb70574c1357 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:34.251734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:34.390795 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d573ad-1ada-4c46-b190-eb70574c1357 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:34.431640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02ee8d-25e9-4ad9-9609-746b7da465bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:34.432565 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02ee8d-25e9-4ad9-9609-746b7da465bc None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:34.432850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02ee8d-25e9-4ad9-9609-746b7da465bc None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:34.433187 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef02ee8d-25e9-4ad9-9609-746b7da465bc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:34.445897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef02ee8d-25e9-4ad9-9609-746b7da465bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-ef02ee8d-25e9-4ad9-9609-746b7da465bc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:57:34.454294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:34.456197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:34.457850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:34.457850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:34.457850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:34.457850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:34.457850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:57:34.457850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:57:34.457850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:57:34.457850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:57:34.457850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:57:34.457850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:57:34.457850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:57:34.457850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:34.457850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 366/720] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:57:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:34.469908 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afad44a-05cf-4f2d-b0b2-9b8ff9786f26 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:34.651122 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:34.663485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afad44a-05cf-4f2d-b0b2-9b8ff9786f26 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:34.726103 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c28c5c1-f195-4f8f-9e41-2fde6628d0a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:34.726682 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28c5c1-f195-4f8f-9e41-2fde6628d0a1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:34.726960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28c5c1-f195-4f8f-9e41-2fde6628d0a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:34.727250 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c28c5c1-f195-4f8f-9e41-2fde6628d0a1 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:34.728069 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28c5c1-f195-4f8f-9e41-2fde6628d0a1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:34.728414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28c5c1-f195-4f8f-9e41-2fde6628d0a1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:34.729837 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c28c5c1-f195-4f8f-9e41-2fde6628d0a1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:34.739946 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 355/721] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:57:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:34.749287 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02ee8d-25e9-4ad9-9609-746b7da465bc None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:34.899601 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:34.929784 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef02ee8d-25e9-4ad9-9609-746b7da465bc None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:34.990111 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc561f77-6583-4592-b9f4-bbe4d991c70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:34.991427 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc561f77-6583-4592-b9f4-bbe4d991c70f None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:34.991912 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc561f77-6583-4592-b9f4-bbe4d991c70f None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:34.992438 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc561f77-6583-4592-b9f4-bbe4d991c70f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:35.012887 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc561f77-6583-4592-b9f4-bbe4d991c70f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:35.015709 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc561f77-6583-4592-b9f4-bbe4d991c70f None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:35.018870 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af01d08-7e45-491f-a38f-10ed88652935 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:35.019748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af01d08-7e45-491f-a38f-10ed88652935 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:35.020285 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af01d08-7e45-491f-a38f-10ed88652935 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:35.026814 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 356/722] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:57:35.029204 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde9eb-0e86-4ac5-b30a-7fba1885aef8 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:35.029828 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde9eb-0e86-4ac5-b30a-7fba1885aef8 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:35.030304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdde9eb-0e86-4ac5-b30a-7fba1885aef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-bc561f77-6583-4592-b9f4-bbe4d991c70f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:35.048793 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:35.049738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:35.050625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:35.050625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:35.050625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:35.050625 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:35.052553 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-9cdde9eb-0e86-4ac5-b30a-7fba1885aef8 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:35.053949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 367/723] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:35.054751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-9cdde9eb-0e86-4ac5-b30a-7fba1885aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:35.060849 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc561f77-6583-4592-b9f4-bbe4d991c70f None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:35.141573 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 357/724] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:35 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:57:35.165700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdde9eb-0e86-4ac5-b30a-7fba1885aef8 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:35.265204 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:35.281647 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc561f77-6583-4592-b9f4-bbe4d991c70f None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:35.283239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdde9eb-0e86-4ac5-b30a-7fba1885aef8 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:35.322821 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b50df5-e5b3-479e-bb77-ca5a30c0353f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:35.323686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b50df5-e5b3-479e-bb77-ca5a30c0353f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:35.324068 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b50df5-e5b3-479e-bb77-ca5a30c0353f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:35.324471 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b50df5-e5b3-479e-bb77-ca5a30c0353f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:35.335818 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:35.346590 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a13479-4d4d-4d8b-bb48-2202cbc7bd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:35.347957 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a13479-4d4d-4d8b-bb48-2202cbc7bd51 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:35.348812 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a13479-4d4d-4d8b-bb48-2202cbc7bd51 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:35.349402 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a13479-4d4d-4d8b-bb48-2202cbc7bd51 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:35.350989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a13479-4d4d-4d8b-bb48-2202cbc7bd51 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:35.351823 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a13479-4d4d-4d8b-bb48-2202cbc7bd51 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:35.353774 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a13479-4d4d-4d8b-bb48-2202cbc7bd51 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:35.367900 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 368/725] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:35.377911 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a13479-4d4d-4d8b-bb48-2202cbc7bd51 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:35.419684 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b50df5-e5b3-479e-bb77-ca5a30c0353f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:35.422895 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b50df5-e5b3-479e-bb77-ca5a30c0353f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:35.512400 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a13479-4d4d-4d8b-bb48-2202cbc7bd51 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:35.550426 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17430472-f540-4dd8-81d4-64330aca1690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:35.551557 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17430472-f540-4dd8-81d4-64330aca1690 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:35.551994 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17430472-f540-4dd8-81d4-64330aca1690 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:35.552455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17430472-f540-4dd8-81d4-64330aca1690 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:35.561641 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:35.562612 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17430472-f540-4dd8-81d4-64330aca1690 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:35.564345 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17430472-f540-4dd8-81d4-64330aca1690 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-17430472-f540-4dd8-81d4-64330aca1690 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:57:35.583180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:35.584249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:35.585191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:35.585191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:35.585191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:57:35.585191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:57:35.585191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:57:35.585191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:57:35.585191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:57:35.585191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:57:35.585191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 25 07:57:35.585191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:35.587549 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 358/726] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:57:35 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 25 07:57:35.588032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 369/727] 10.222.0.25 () {56 vars in 1093 bytes} [Wed May 25 07:57:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:35.593814 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b50df5-e5b3-479e-bb77-ca5a30c0353f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:35.594742 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17430472-f540-4dd8-81d4-64330aca1690 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:35.680211 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:35.714747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b50df5-e5b3-479e-bb77-ca5a30c0353f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:35.754504 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a53fc-8e47-456c-b11b-0b7dea6cc2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:35.755700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a53fc-8e47-456c-b11b-0b7dea6cc2ea None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:35.756345 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a53fc-8e47-456c-b11b-0b7dea6cc2ea None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:35.756824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744a53fc-8e47-456c-b11b-0b7dea6cc2ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:35.769316 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a53fc-8e47-456c-b11b-0b7dea6cc2ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:35.771159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744a53fc-8e47-456c-b11b-0b7dea6cc2ea None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:35.781525 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17430472-f540-4dd8-81d4-64330aca1690 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-744a53fc-8e47-456c-b11b-0b7dea6cc2ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:35.792950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:35.793887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:35.794772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:35.794772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:35.794772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:35.794772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:35.797266 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 359/728] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:35.808319 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a53fc-8e47-456c-b11b-0b7dea6cc2ea None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:35.827074 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f119b02-b299-4b8b-bff6-4539a00263fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:35.827873 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f119b02-b299-4b8b-bff6-4539a00263fb None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:35.828202 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f119b02-b299-4b8b-bff6-4539a00263fb None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:35.828603 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f119b02-b299-4b8b-bff6-4539a00263fb None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:35.829472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f119b02-b299-4b8b-bff6-4539a00263fb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:35.829898 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f119b02-b299-4b8b-bff6-4539a00263fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:35.831592 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f119b02-b299-4b8b-bff6-4539a00263fb None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:35.855604 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 370/729] 10.222.0.25 () {56 vars in 1133 bytes} [Wed May 25 07:57:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:35.861811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f119b02-b299-4b8b-bff6-4539a00263fb None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:35.869140 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:35.976755 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744a53fc-8e47-456c-b11b-0b7dea6cc2ea None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:36.006626 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f119b02-b299-4b8b-bff6-4539a00263fb None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:36.034208 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:36.042892 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e996e-8390-4c9a-89e5-9708245cb120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:36.043763 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e996e-8390-4c9a-89e5-9708245cb120 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:36.043949 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e996e-8390-4c9a-89e5-9708245cb120 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:36.044285 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e996e-8390-4c9a-89e5-9708245cb120 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:36.045024 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e996e-8390-4c9a-89e5-9708245cb120 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:36.045336 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e996e-8390-4c9a-89e5-9708245cb120 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:36.046782 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4e996e-8390-4c9a-89e5-9708245cb120 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:36.064272 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 360/730] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:36.064272 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c678970-7f41-4336-9a66-b57799beb79b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:36.064272 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c678970-7f41-4336-9a66-b57799beb79b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:36.064272 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c678970-7f41-4336-9a66-b57799beb79b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:36.068643 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 361/731] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:36.072350 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed951249-1eed-462e-b87e-bf8e2ff5346b None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:36.073010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed951249-1eed-462e-b87e-bf8e2ff5346b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:36.073518 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed951249-1eed-462e-b87e-bf8e2ff5346b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:36.093890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-ed951249-1eed-462e-b87e-bf8e2ff5346b None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:36.095510 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-ed951249-1eed-462e-b87e-bf8e2ff5346b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:36.099059 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fe490-b5ed-44d9-83dd-c93b9c42827e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:36.101828 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fe490-b5ed-44d9-83dd-c93b9c42827e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:36.102324 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fe490-b5ed-44d9-83dd-c93b9c42827e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:36.103319 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370fe490-b5ed-44d9-83dd-c93b9c42827e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:36.227351 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 362/732] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:36 2022] POST /identity/v3/auth/tokens => generated 1247 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:57:36.249265 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fe490-b5ed-44d9-83dd-c93b9c42827e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:36.252729 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370fe490-b5ed-44d9-83dd-c93b9c42827e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:36.273194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed951249-1eed-462e-b87e-bf8e2ff5346b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:36.332470 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:36.459551 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed951249-1eed-462e-b87e-bf8e2ff5346b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:36.483067 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 371/733] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:57:35 2022] GET /identity/v3/auth/tokens => generated 1247 bytes in 621 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:57:36.491777 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fe490-b5ed-44d9-83dd-c93b9c42827e None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:36.506756 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:36.522719 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058d6ff-cf0a-4c4b-8fdd-2b3e0b6b8e56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:36.523831 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058d6ff-cf0a-4c4b-8fdd-2b3e0b6b8e56 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:36.524349 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058d6ff-cf0a-4c4b-8fdd-2b3e0b6b8e56 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:36.524634 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3058d6ff-cf0a-4c4b-8fdd-2b3e0b6b8e56 None admin] PATH_INFO: `/v3/services/network` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:36.525375 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058d6ff-cf0a-4c4b-8fdd-2b3e0b6b8e56 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:36.526951 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3058d6ff-cf0a-4c4b-8fdd-2b3e0b6b8e56 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-3058d6ff-cf0a-4c4b-8fdd-2b3e0b6b8e56 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:36.540363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:36.542530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:36.545308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 363/734] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:36 2022] GET /identity/v3/services/network => generated 88 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:36.549640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058d6ff-cf0a-4c4b-8fdd-2b3e0b6b8e56 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:36.665531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:36.678263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3058d6ff-cf0a-4c4b-8fdd-2b3e0b6b8e56 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:36.689351 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370fe490-b5ed-44d9-83dd-c93b9c42827e None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:36.734509 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4d5e4-ff46-4a58-a742-cd48ffd7618b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:36.735627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4d5e4-ff46-4a58-a742-cd48ffd7618b None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:36.736132 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4d5e4-ff46-4a58-a742-cd48ffd7618b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:36.736657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d4d5e4-ff46-4a58-a742-cd48ffd7618b None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:36.738020 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4d5e4-ff46-4a58-a742-cd48ffd7618b None admin] RBAC: Adding query filter params (name=network) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:36.738531 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4d5e4-ff46-4a58-a742-cd48ffd7618b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:36.739912 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83e54b-bed9-40a2-960e-e7f9ef5f17e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:36.741262 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d4d5e4-ff46-4a58-a742-cd48ffd7618b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:36.741408 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83e54b-bed9-40a2-960e-e7f9ef5f17e6 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:36.741850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83e54b-bed9-40a2-960e-e7f9ef5f17e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:36.742363 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f83e54b-bed9-40a2-960e-e7f9ef5f17e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:36.756009 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 364/735] 10.222.0.25 () {56 vars in 1112 bytes} [Wed May 25 07:57:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:36.758045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4d5e4-ff46-4a58-a742-cd48ffd7618b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:36.764104 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83e54b-bed9-40a2-960e-e7f9ef5f17e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:36.767228 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f83e54b-bed9-40a2-960e-e7f9ef5f17e6 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-3f83e54b-bed9-40a2-960e-e7f9ef5f17e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:57:36.803359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:36.804628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:36.805605 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:57:36.805605 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:57:36.805605 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:57:36.805605 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:36.806006 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 372/736] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:36.815359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83e54b-bed9-40a2-960e-e7f9ef5f17e6 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:36.908088 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d4d5e4-ff46-4a58-a742-cd48ffd7618b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:36.922090 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:36.973912 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd79732f-cba2-402b-903c-2cebf1f533c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:36.974613 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79732f-cba2-402b-903c-2cebf1f533c0 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:36.974892 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79732f-cba2-402b-903c-2cebf1f533c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:36.975163 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd79732f-cba2-402b-903c-2cebf1f533c0 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:36.975931 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79732f-cba2-402b-903c-2cebf1f533c0 None admin] RBAC: Adding query filter params (type=network) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:36.976274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79732f-cba2-402b-903c-2cebf1f533c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:36.978210 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd79732f-cba2-402b-903c-2cebf1f533c0 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:36.984008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 365/737] 10.222.0.25 () {56 vars in 1112 bytes} [Wed May 25 07:57:36 2022] GET /identity/v3/services?type=network => generated 350 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:36.985502 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba69f0-1eec-49a1-aa43-54d8369773d0 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:36.985793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba69f0-1eec-49a1-aa43-54d8369773d0 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:36.986073 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ba69f0-1eec-49a1-aa43-54d8369773d0 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:36.987382 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 366/738] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:36.990166 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba69f0-1eec-49a1-aa43-54d8369773d0 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:36.991707 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f83e54b-bed9-40a2-960e-e7f9ef5f17e6 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:37.020507 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:37.048650 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf9a642-a44b-4840-b348-a9f654232d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:37.049674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9a642-a44b-4840-b348-a9f654232d0b None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:37.050192 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9a642-a44b-4840-b348-a9f654232d0b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:37.050713 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf9a642-a44b-4840-b348-a9f654232d0b None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:37.051910 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9a642-a44b-4840-b348-a9f654232d0b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:37.052357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9a642-a44b-4840-b348-a9f654232d0b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:37.053886 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf9a642-a44b-4840-b348-a9f654232d0b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:37.072035 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 373/739] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:37.074577 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2d59c-7185-419f-9b47-ef3981241e4f None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:37.075097 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2d59c-7185-419f-9b47-ef3981241e4f None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:37.075735 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2d59c-7185-419f-9b47-ef3981241e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:37.103364 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-24c2d59c-7185-419f-9b47-ef3981241e4f None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:37.104806 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-24c2d59c-7185-419f-9b47-ef3981241e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:37.139715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ba69f0-1eec-49a1-aa43-54d8369773d0 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:37.179301 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf181e9-4d6b-4796-baf3-a50a3be0310b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:37.180448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf181e9-4d6b-4796-baf3-a50a3be0310b None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:37.180873 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf181e9-4d6b-4796-baf3-a50a3be0310b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:37.181239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf181e9-4d6b-4796-baf3-a50a3be0310b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:37.182087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf181e9-4d6b-4796-baf3-a50a3be0310b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:37.183695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf181e9-4d6b-4796-baf3-a50a3be0310b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:37.204810 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 367/740] 10.222.0.25 () {60 vars in 1144 bytes} [Wed May 25 07:57:36 2022] POST /identity/v3/endpoints => generated 327 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:57:37.205673 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf181e9-4d6b-4796-baf3-a50a3be0310b None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:37.243250 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 374/741] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:37 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:57:37.288325 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2d59c-7185-419f-9b47-ef3981241e4f None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:37.318686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:37.370394 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf181e9-4d6b-4796-baf3-a50a3be0310b None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:37.380937 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:37.442455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cc108-d525-4bab-9dc3-ada15b344574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:37.443173 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cc108-d525-4bab-9dc3-ada15b344574 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:37.443895 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cc108-d525-4bab-9dc3-ada15b344574 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:37.443895 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0cc108-d525-4bab-9dc3-ada15b344574 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:37.458528 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cc108-d525-4bab-9dc3-ada15b344574 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:37.460066 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0cc108-d525-4bab-9dc3-ada15b344574 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-0c0cc108-d525-4bab-9dc3-ada15b344574 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:37.477458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:37.479492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:37.481357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:37.481357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:37.481357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:37.481357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:37.481357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:37.481357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:37.481357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:37.481357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:37.481357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 368/742] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:37.482294 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2d59c-7185-419f-9b47-ef3981241e4f None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:37.488087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cc108-d525-4bab-9dc3-ada15b344574 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:37.528169 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febf00f-b994-4ce7-8fdd-3ffb3c5ddbb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:37.529305 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf00f-b994-4ce7-8fdd-3ffb3c5ddbb7 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:37.529584 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf00f-b994-4ce7-8fdd-3ffb3c5ddbb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:37.529880 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9febf00f-b994-4ce7-8fdd-3ffb3c5ddbb7 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:37.530540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febf00f-b994-4ce7-8fdd-3ffb3c5ddbb7 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:37.531943 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9febf00f-b994-4ce7-8fdd-3ffb3c5ddbb7 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-9febf00f-b994-4ce7-8fdd-3ffb3c5ddbb7 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:37.545137 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:37.547081 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:37.548870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 375/743] 10.222.0.25 () {56 vars in 1129 bytes} [Wed May 25 07:57:37 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:37.553850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febf00f-b994-4ce7-8fdd-3ffb3c5ddbb7 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:37.622712 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0cc108-d525-4bab-9dc3-ada15b344574 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:37.677249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4595d6-c34a-47e4-be91-e2403c20977d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:37.678517 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4595d6-c34a-47e4-be91-e2403c20977d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:37.679043 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4595d6-c34a-47e4-be91-e2403c20977d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:37.679557 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4595d6-c34a-47e4-be91-e2403c20977d None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:37.681335 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4595d6-c34a-47e4-be91-e2403c20977d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:37.682091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4595d6-c34a-47e4-be91-e2403c20977d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:37.684950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4595d6-c34a-47e4-be91-e2403c20977d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:37.689389 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9febf00f-b994-4ce7-8fdd-3ffb3c5ddbb7 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:37.689988 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:37.702831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:37.715149 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 369/744] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:57:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:37.717026 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4595d6-c34a-47e4-be91-e2403c20977d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:37.729405 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c1582-c6c1-402d-9ff2-5f4f93872d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:37.730212 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c1582-c6c1-402d-9ff2-5f4f93872d1a None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:37.730585 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c1582-c6c1-402d-9ff2-5f4f93872d1a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:37.730960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c1582-c6c1-402d-9ff2-5f4f93872d1a None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:37.731761 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c1582-c6c1-402d-9ff2-5f4f93872d1a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:37.732191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c1582-c6c1-402d-9ff2-5f4f93872d1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:37.733908 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c1582-c6c1-402d-9ff2-5f4f93872d1a None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:37.740076 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 376/745] 10.222.0.25 () {56 vars in 1124 bytes} [Wed May 25 07:57:37 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:37.746647 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c1582-c6c1-402d-9ff2-5f4f93872d1a None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:37.839274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4595d6-c34a-47e4-be91-e2403c20977d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:37.882312 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c1582-c6c1-402d-9ff2-5f4f93872d1a None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:37.892989 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad59dbf-21a9-4cca-83c4-e75bbeff6fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:37.894034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad59dbf-21a9-4cca-83c4-e75bbeff6fb5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:37.894491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad59dbf-21a9-4cca-83c4-e75bbeff6fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:37.894953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad59dbf-21a9-4cca-83c4-e75bbeff6fb5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:37.896194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad59dbf-21a9-4cca-83c4-e75bbeff6fb5 None admin] RBAC: Adding query filter params (role.id=5c1382efdc2e4eebaf5f15a4cdae58e0, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=0b9bc11432e04e779fffd35473e6fbfa) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:37.896714 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad59dbf-21a9-4cca-83c4-e75bbeff6fb5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:37.899207 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad59dbf-21a9-4cca-83c4-e75bbeff6fb5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:37.909501 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 370/746] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:57:37 2022] GET /identity/v3/role_assignments?user.id=0b9bc11432e04e779fffd35473e6fbfa&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:37.933219 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f65fc80-6ab2-4cb5-adcc-21258f2066c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:37.933985 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65fc80-6ab2-4cb5-adcc-21258f2066c2 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:37.934324 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65fc80-6ab2-4cb5-adcc-21258f2066c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:37.934659 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f65fc80-6ab2-4cb5-adcc-21258f2066c2 None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:37.935466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65fc80-6ab2-4cb5-adcc-21258f2066c2 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:37.935834 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65fc80-6ab2-4cb5-adcc-21258f2066c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:37.937560 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f65fc80-6ab2-4cb5-adcc-21258f2066c2 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:37.943997 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 377/747] 10.222.0.25 () {56 vars in 1124 bytes} [Wed May 25 07:57:37 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:37.951459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad59dbf-21a9-4cca-83c4-e75bbeff6fb5 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:38.070217 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:38.146915 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad59dbf-21a9-4cca-83c4-e75bbeff6fb5 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:38.192833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61a1566-b171-4163-bc91-501ba0de4ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:38.193586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a1566-b171-4163-bc91-501ba0de4ac7 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:38.193911 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a1566-b171-4163-bc91-501ba0de4ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:38.194270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61a1566-b171-4163-bc91-501ba0de4ac7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:38.195114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a1566-b171-4163-bc91-501ba0de4ac7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:38.196711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61a1566-b171-4163-bc91-501ba0de4ac7 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:38.219836 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 371/748] 10.222.0.25 () {60 vars in 1144 bytes} [Wed May 25 07:57:37 2022] POST /identity/v3/endpoints => generated 346 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:57:40.495129 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f32f5-7ab9-4d85-b3ea-cff0136d2112 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:40.495671 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f32f5-7ab9-4d85-b3ea-cff0136d2112 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:40.495759 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411f32f5-7ab9-4d85-b3ea-cff0136d2112 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:40.497308 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 378/749] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:40.503017 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ece72-3f3d-4e1d-9929-21c6908094a2 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:40.503530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ece72-3f3d-4e1d-9929-21c6908094a2 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:40.503667 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9ece72-3f3d-4e1d-9929-21c6908094a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:40.521698 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-da9ece72-3f3d-4e1d-9929-21c6908094a2 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:40.522914 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-da9ece72-3f3d-4e1d-9929-21c6908094a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:40.600091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 372/750] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:40 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:57:40.623446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f32f5-7ab9-4d85-b3ea-cff0136d2112 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:40.673228 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:40.739418 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411f32f5-7ab9-4d85-b3ea-cff0136d2112 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:40.776540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ecb2f-3469-4de6-bc70-4fec69c0aee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:40.777290 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ecb2f-3469-4de6-bc70-4fec69c0aee8 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:40.777576 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ecb2f-3469-4de6-bc70-4fec69c0aee8 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:40.777855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668ecb2f-3469-4de6-bc70-4fec69c0aee8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:40.778524 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ecb2f-3469-4de6-bc70-4fec69c0aee8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:40.779965 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668ecb2f-3469-4de6-bc70-4fec69c0aee8 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-668ecb2f-3469-4de6-bc70-4fec69c0aee8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:40.795277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:40.797008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:40.798648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 379/751] 10.222.0.25 () {56 vars in 1132 bytes} [Wed May 25 07:57:40 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:40.806178 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ece72-3f3d-4e1d-9929-21c6908094a2 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:40.853730 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:40.922745 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9ece72-3f3d-4e1d-9929-21c6908094a2 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:40.965246 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79ddb5a-06db-48ba-803e-2ddd63fe4139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:40.965939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ddb5a-06db-48ba-803e-2ddd63fe4139 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:40.966228 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ddb5a-06db-48ba-803e-2ddd63fe4139 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:40.966506 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79ddb5a-06db-48ba-803e-2ddd63fe4139 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:40.967239 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ddb5a-06db-48ba-803e-2ddd63fe4139 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:40.967548 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ddb5a-06db-48ba-803e-2ddd63fe4139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:40.969104 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79ddb5a-06db-48ba-803e-2ddd63fe4139 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:40.974455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 373/752] 10.222.0.25 () {56 vars in 1126 bytes} [Wed May 25 07:57:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:40.980604 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ecb2f-3469-4de6-bc70-4fec69c0aee8 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:41.091901 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668ecb2f-3469-4de6-bc70-4fec69c0aee8 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:41.093620 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:41.131834 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c660f-a28a-40f6-97db-98fba15b60a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:41.132554 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c660f-a28a-40f6-97db-98fba15b60a0 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:41.132842 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c660f-a28a-40f6-97db-98fba15b60a0 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:41.133119 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c660f-a28a-40f6-97db-98fba15b60a0 None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:41.133863 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c660f-a28a-40f6-97db-98fba15b60a0 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:41.134174 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c660f-a28a-40f6-97db-98fba15b60a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:41.135610 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c660f-a28a-40f6-97db-98fba15b60a0 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:41.141375 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 380/753] 10.222.0.25 () {56 vars in 1126 bytes} [Wed May 25 07:57:40 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:41.486040 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d4cf-65c7-4305-aff2-c39baa3332be None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:41.486559 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d4cf-65c7-4305-aff2-c39baa3332be None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:41.487075 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0d4cf-65c7-4305-aff2-c39baa3332be None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:41.489524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 374/754] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:41.498495 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7bc3d-4ac5-4437-9afc-3c1056cfb9a7 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:41.499017 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7bc3d-4ac5-4437-9afc-3c1056cfb9a7 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:41.499213 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7bc3d-4ac5-4437-9afc-3c1056cfb9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:41.520239 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-e6e7bc3d-4ac5-4437-9afc-3c1056cfb9a7 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:41.521469 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-e6e7bc3d-4ac5-4437-9afc-3c1056cfb9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:41.598604 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 381/755] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:41 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:57:41.622030 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0d4cf-65c7-4305-aff2-c39baa3332be None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:41.741116 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d0d4cf-65c7-4305-aff2-c39baa3332be None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:41.750048 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:41.784902 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007e1e9-b99c-4567-8069-e971b2418a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:41.785725 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007e1e9-b99c-4567-8069-e971b2418a29 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:41.786010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007e1e9-b99c-4567-8069-e971b2418a29 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:41.786291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7007e1e9-b99c-4567-8069-e971b2418a29 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:41.786965 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007e1e9-b99c-4567-8069-e971b2418a29 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:41.788453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7007e1e9-b99c-4567-8069-e971b2418a29 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-7007e1e9-b99c-4567-8069-e971b2418a29 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:41.800944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:41.802331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:41.803189 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 375/756] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:57:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:41.810455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7bc3d-4ac5-4437-9afc-3c1056cfb9a7 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:41.925317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:41.932167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7bc3d-4ac5-4437-9afc-3c1056cfb9a7 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:41.967252 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15700ae3-9e1b-4cf0-b7ac-35abefc3edc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:41.967926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15700ae3-9e1b-4cf0-b7ac-35abefc3edc5 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:41.968238 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15700ae3-9e1b-4cf0-b7ac-35abefc3edc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:41.968738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15700ae3-9e1b-4cf0-b7ac-35abefc3edc5 None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:41.969509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15700ae3-9e1b-4cf0-b7ac-35abefc3edc5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:41.969819 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15700ae3-9e1b-4cf0-b7ac-35abefc3edc5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:41.971201 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15700ae3-9e1b-4cf0-b7ac-35abefc3edc5 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:41.976363 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 382/757] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:57:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:41.982559 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007e1e9-b99c-4567-8069-e971b2418a29 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:42.096244 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7007e1e9-b99c-4567-8069-e971b2418a29 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:42.153590 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa7a14-4d1a-431d-a9d8-b54375ba4f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:42.154739 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa7a14-4d1a-431d-a9d8-b54375ba4f45 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:42.155246 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa7a14-4d1a-431d-a9d8-b54375ba4f45 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:42.155762 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa7a14-4d1a-431d-a9d8-b54375ba4f45 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:42.157131 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa7a14-4d1a-431d-a9d8-b54375ba4f45 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:42.157461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa7a14-4d1a-431d-a9d8-b54375ba4f45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:42.160074 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa7a14-4d1a-431d-a9d8-b54375ba4f45 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:42.167157 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 376/758] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:57:41 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:43.587744 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f590fb-fbf9-4246-bf47-8c1e7244d214 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:43.588336 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f590fb-fbf9-4246-bf47-8c1e7244d214 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:43.588748 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f590fb-fbf9-4246-bf47-8c1e7244d214 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:43.590696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 383/759] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:43.599185 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ace5e6-2d88-476b-98df-a29dfae30b68 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:43.599959 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ace5e6-2d88-476b-98df-a29dfae30b68 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:43.600115 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ace5e6-2d88-476b-98df-a29dfae30b68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:43.620004 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-93ace5e6-2d88-476b-98df-a29dfae30b68 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:43.621256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-93ace5e6-2d88-476b-98df-a29dfae30b68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:43.653111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:43.699421 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 377/760] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:43 2022] POST /identity/v3/auth/tokens => generated 1396 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:57:43.724547 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f590fb-fbf9-4246-bf47-8c1e7244d214 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:43.850211 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f590fb-fbf9-4246-bf47-8c1e7244d214 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:43.894184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c38889-6fc0-4381-8aac-7a38332aaabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:43.894867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c38889-6fc0-4381-8aac-7a38332aaabf None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:43.895155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c38889-6fc0-4381-8aac-7a38332aaabf None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:43.895436 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c38889-6fc0-4381-8aac-7a38332aaabf None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:43.896232 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c38889-6fc0-4381-8aac-7a38332aaabf None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:43.897639 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c38889-6fc0-4381-8aac-7a38332aaabf None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:43.918438 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 384/761] 10.222.0.25 () {60 vars in 1141 bytes} [Wed May 25 07:57:43 2022] POST /identity/v3/services => generated 269 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:57:44.536310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fe045-25e0-45cd-8406-9611624baeef None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:44.536826 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fe045-25e0-45cd-8406-9611624baeef None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:44.537338 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9fe045-25e0-45cd-8406-9611624baeef None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:44.539773 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 378/762] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:44.548175 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b206-9b61-4c29-a9ac-470a0987b3f4 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:44.548616 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b206-9b61-4c29-a9ac-470a0987b3f4 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:44.548969 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d6b206-9b61-4c29-a9ac-470a0987b3f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:44.571598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-c9d6b206-9b61-4c29-a9ac-470a0987b3f4 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:44.572964 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-c9d6b206-9b61-4c29-a9ac-470a0987b3f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:44.589029 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:44.660102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 385/763] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:44 2022] POST /identity/v3/auth/tokens => generated 1506 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:57:44.703202 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fe045-25e0-45cd-8406-9611624baeef None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:44.855122 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9fe045-25e0-45cd-8406-9611624baeef None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:44.896251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275e04-ec96-4b54-81ef-0a5281624989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:44.896945 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275e04-ec96-4b54-81ef-0a5281624989 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:44.897233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275e04-ec96-4b54-81ef-0a5281624989 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:44.897513 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275e04-ec96-4b54-81ef-0a5281624989 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:44.898279 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275e04-ec96-4b54-81ef-0a5281624989 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:44.900759 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275e04-ec96-4b54-81ef-0a5281624989 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:44.917229 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 379/764] 10.222.0.25 () {60 vars in 1141 bytes} [Wed May 25 07:57:44 2022] POST /identity/v3/services => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:57:47.110879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5a3cb-d80d-4611-996a-76209c9ed4ea None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:47.111463 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5a3cb-d80d-4611-996a-76209c9ed4ea None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:47.111911 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd5a3cb-d80d-4611-996a-76209c9ed4ea None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:47.114718 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 386/765] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:47.121152 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0177bc2-4d38-475d-9d7a-33dfd2826257 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:47.121945 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0177bc2-4d38-475d-9d7a-33dfd2826257 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:47.122102 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0177bc2-4d38-475d-9d7a-33dfd2826257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:47.141762 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-d0177bc2-4d38-475d-9d7a-33dfd2826257 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:47.143082 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-d0177bc2-4d38-475d-9d7a-33dfd2826257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:47.164630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:47.229494 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 380/766] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:47 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:57:47.254703 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5a3cb-d80d-4611-996a-76209c9ed4ea None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:47.442447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd5a3cb-d80d-4611-996a-76209c9ed4ea None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:47.485118 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0201b5-3833-4280-bb94-87c67ba327a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:47.486038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0201b5-3833-4280-bb94-87c67ba327a9 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:47.486409 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0201b5-3833-4280-bb94-87c67ba327a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:47.486757 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0201b5-3833-4280-bb94-87c67ba327a9 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:47.487579 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0201b5-3833-4280-bb94-87c67ba327a9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:47.489127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0201b5-3833-4280-bb94-87c67ba327a9 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-9a0201b5-3833-4280-bb94-87c67ba327a9 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:47.502916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:47.504855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:47.507010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 387/767] 10.222.0.25 () {56 vars in 1132 bytes} [Wed May 25 07:57:47 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:47.513844 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0177bc2-4d38-475d-9d7a-33dfd2826257 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:47.622754 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0177bc2-4d38-475d-9d7a-33dfd2826257 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:47.666891 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7632c-f038-4425-be11-b55178c41813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:47.668034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7632c-f038-4425-be11-b55178c41813 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:47.668541 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7632c-f038-4425-be11-b55178c41813 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:47.669033 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7632c-f038-4425-be11-b55178c41813 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:47.670364 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7632c-f038-4425-be11-b55178c41813 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:47.670911 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7632c-f038-4425-be11-b55178c41813 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:47.673492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7632c-f038-4425-be11-b55178c41813 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:47.687867 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 381/768] 10.222.0.25 () {56 vars in 1126 bytes} [Wed May 25 07:57:47 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:47.689210 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0201b5-3833-4280-bb94-87c67ba327a9 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:47.704902 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:47.870703 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0201b5-3833-4280-bb94-87c67ba327a9 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:47.913500 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80ec77-559a-41f8-999e-df99ed26f298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:47.914821 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ec77-559a-41f8-999e-df99ed26f298 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:47.915200 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ec77-559a-41f8-999e-df99ed26f298 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:47.915564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80ec77-559a-41f8-999e-df99ed26f298 None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:47.916422 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80ec77-559a-41f8-999e-df99ed26f298 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:47.916836 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80ec77-559a-41f8-999e-df99ed26f298 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:47.918340 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80ec77-559a-41f8-999e-df99ed26f298 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:47.924335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 388/769] 10.222.0.25 () {56 vars in 1126 bytes} [Wed May 25 07:57:47 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:47.931322 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7632c-f038-4425-be11-b55178c41813 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:47.948523 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:48.067462 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7632c-f038-4425-be11-b55178c41813 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:48.106447 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b56750-8f62-4f05-85a2-fee0871dc18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:48.107180 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b56750-8f62-4f05-85a2-fee0871dc18d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:48.107501 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b56750-8f62-4f05-85a2-fee0871dc18d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:48.107817 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b56750-8f62-4f05-85a2-fee0871dc18d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:48.108749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b56750-8f62-4f05-85a2-fee0871dc18d None admin] RBAC: Adding query filter params (interface=public, service_id=c86caeeb6f7c4d81a619650c6dcafcb4, region_id=RegionOne) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:48.109110 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b56750-8f62-4f05-85a2-fee0871dc18d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:48.110606 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b56750-8f62-4f05-85a2-fee0871dc18d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:48.117111 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 382/770] 10.222.0.25 () {56 vars in 1251 bytes} [Wed May 25 07:57:47 2022] GET /identity/v3/endpoints?service_id=c86caeeb6f7c4d81a619650c6dcafcb4&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:48.123300 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80ec77-559a-41f8-999e-df99ed26f298 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:48.210937 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffcacd-3855-4b6d-91f2-915b725d6dcb None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:48.212281 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffcacd-3855-4b6d-91f2-915b725d6dcb None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:48.212281 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ffcacd-3855-4b6d-91f2-915b725d6dcb None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:48.213469 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 383/771] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:57:48.219071 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bd4ec-def4-4cfd-b1cd-06803ec67dc5 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:48.219359 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bd4ec-def4-4cfd-b1cd-06803ec67dc5 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:48.219638 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2bd4ec-def4-4cfd-b1cd-06803ec67dc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:48.237235 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-1b2bd4ec-def4-4cfd-b1cd-06803ec67dc5 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:48.238450 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-1b2bd4ec-def4-4cfd-b1cd-06803ec67dc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:48.246057 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:48.278064 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80ec77-559a-41f8-999e-df99ed26f298 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:48.325747 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4c951-0e0c-4322-997d-c6cdcd12ecf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:48.326853 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c951-0e0c-4322-997d-c6cdcd12ecf7 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:48.327360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c951-0e0c-4322-997d-c6cdcd12ecf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:48.327732 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 384/772] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:48 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:57:48.327850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4c951-0e0c-4322-997d-c6cdcd12ecf7 None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:48.329179 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4c951-0e0c-4322-997d-c6cdcd12ecf7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:48.331803 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d4c951-0e0c-4322-997d-c6cdcd12ecf7 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:48.350895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 389/773] 10.222.0.25 () {56 vars in 1087 bytes} [Wed May 25 07:57:48 2022] GET /identity/v3/services => generated 1498 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:57:48.352916 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bd4ec-def4-4cfd-b1cd-06803ec67dc5 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:48.365598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:48.477860 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2bd4ec-def4-4cfd-b1cd-06803ec67dc5 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:48.522954 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c83e43-99e2-4251-9857-a9c7b789fb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:48.523910 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c83e43-99e2-4251-9857-a9c7b789fb64 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:48.524319 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c83e43-99e2-4251-9857-a9c7b789fb64 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:48.524661 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c83e43-99e2-4251-9857-a9c7b789fb64 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:48.525442 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c83e43-99e2-4251-9857-a9c7b789fb64 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:48.527013 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c83e43-99e2-4251-9857-a9c7b789fb64 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-c5c83e43-99e2-4251-9857-a9c7b789fb64 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:48.540170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:48.541960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:48.543461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 385/774] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:57:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:57:48.551739 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4c951-0e0c-4322-997d-c6cdcd12ecf7 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:48.720569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4c951-0e0c-4322-997d-c6cdcd12ecf7 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:48.760106 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e55c93-9ff6-4651-a84a-8c7941d45bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:48.760953 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e55c93-9ff6-4651-a84a-8c7941d45bcc None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:48.761354 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e55c93-9ff6-4651-a84a-8c7941d45bcc None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:48.761741 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e55c93-9ff6-4651-a84a-8c7941d45bcc None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:48.762567 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e55c93-9ff6-4651-a84a-8c7941d45bcc None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:48.762975 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e55c93-9ff6-4651-a84a-8c7941d45bcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:48.764780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e55c93-9ff6-4651-a84a-8c7941d45bcc None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:48.770693 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 390/775] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:57:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:48.776976 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c83e43-99e2-4251-9857-a9c7b789fb64 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:48.863123 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:48.903707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c83e43-99e2-4251-9857-a9c7b789fb64 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:48.970345 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5438c6-8299-4b0e-9f63-62925dba0dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:48.971522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5438c6-8299-4b0e-9f63-62925dba0dfd None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:48.971968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5438c6-8299-4b0e-9f63-62925dba0dfd None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:48.972469 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5438c6-8299-4b0e-9f63-62925dba0dfd None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:48.973781 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5438c6-8299-4b0e-9f63-62925dba0dfd None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:48.974311 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5438c6-8299-4b0e-9f63-62925dba0dfd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:48.976988 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5438c6-8299-4b0e-9f63-62925dba0dfd None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:48.986446 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 386/776] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:57:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:48.994000 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e55c93-9ff6-4651-a84a-8c7941d45bcc None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:48.998713 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:49.167740 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e55c93-9ff6-4651-a84a-8c7941d45bcc None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:49.225509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6768c6-bdb3-47bd-99ef-84d3183c8e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:49.226335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6768c6-bdb3-47bd-99ef-84d3183c8e1a None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:49.226711 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6768c6-bdb3-47bd-99ef-84d3183c8e1a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:49.227810 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6768c6-bdb3-47bd-99ef-84d3183c8e1a None admin] PATH_INFO: `/v3/endpoints` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:49.228796 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6768c6-bdb3-47bd-99ef-84d3183c8e1a None admin] RBAC: Adding query filter params (interface=public, service_id=3fd805444bba4c8e87edc5f11fcf2e61, region_id=RegionOne) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:49.229218 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6768c6-bdb3-47bd-99ef-84d3183c8e1a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:49.230788 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6768c6-bdb3-47bd-99ef-84d3183c8e1a None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:49.237229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 391/777] 10.222.0.25 () {56 vars in 1251 bytes} [Wed May 25 07:57:48 2022] GET /identity/v3/endpoints?service_id=3fd805444bba4c8e87edc5f11fcf2e61&interface=public®ion_id=RegionOne => generated 194 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:49.243790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5438c6-8299-4b0e-9f63-62925dba0dfd None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:49.413534 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5438c6-8299-4b0e-9f63-62925dba0dfd None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:49.460668 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c34bd7-6595-45ea-afd2-d1ebf78f3c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:49.462130 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c34bd7-6595-45ea-afd2-d1ebf78f3c70 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:49.462422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c34bd7-6595-45ea-afd2-d1ebf78f3c70 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:49.462734 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c34bd7-6595-45ea-afd2-d1ebf78f3c70 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:49.464095 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c34bd7-6595-45ea-afd2-d1ebf78f3c70 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:49.466906 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c34bd7-6595-45ea-afd2-d1ebf78f3c70 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:49.470542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:49.480344 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 387/778] 10.222.0.25 () {56 vars in 1087 bytes} [Wed May 25 07:57:49 2022] GET /identity/v3/services => generated 1498 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:57:50.755012 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b571d-4c17-4430-8d7f-8fc722e1ee58 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:50.755681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b571d-4c17-4430-8d7f-8fc722e1ee58 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:50.755881 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80b571d-4c17-4430-8d7f-8fc722e1ee58 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:50.758354 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 392/779] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:50.766202 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fbf55-8a29-457c-a9b1-df2170fee63f None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:50.767000 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fbf55-8a29-457c-a9b1-df2170fee63f None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:50.767000 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fbf55-8a29-457c-a9b1-df2170fee63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:50.786056 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-323fbf55-8a29-457c-a9b1-df2170fee63f None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:50.787462 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-323fbf55-8a29-457c-a9b1-df2170fee63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:50.865990 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 388/780] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:50 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:57:50.911315 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b571d-4c17-4430-8d7f-8fc722e1ee58 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:51.015843 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:51.057369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80b571d-4c17-4430-8d7f-8fc722e1ee58 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:51.119402 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b15004-bdf5-4035-8587-c5a7b2034beb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:51.120860 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b15004-bdf5-4035-8587-c5a7b2034beb None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:51.121358 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b15004-bdf5-4035-8587-c5a7b2034beb None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:51.121833 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b15004-bdf5-4035-8587-c5a7b2034beb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:51.123035 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b15004-bdf5-4035-8587-c5a7b2034beb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:51.125667 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b15004-bdf5-4035-8587-c5a7b2034beb None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-93b15004-bdf5-4035-8587-c5a7b2034beb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:51.150883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:51.152321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 25 07:57:51.153416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:51.155642 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 393/781] 10.222.0.25 () {56 vars in 1132 bytes} [Wed May 25 07:57:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:51.161736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fbf55-8a29-457c-a9b1-df2170fee63f None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:51.286752 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323fbf55-8a29-457c-a9b1-df2170fee63f None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:51.339026 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:51.348894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681700-3cfd-4fdc-bcbc-13540e804ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:51.350011 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681700-3cfd-4fdc-bcbc-13540e804ffc None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:51.350506 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681700-3cfd-4fdc-bcbc-13540e804ffc None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:51.350994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd681700-3cfd-4fdc-bcbc-13540e804ffc None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:51.352389 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681700-3cfd-4fdc-bcbc-13540e804ffc None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:51.352948 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681700-3cfd-4fdc-bcbc-13540e804ffc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:51.355528 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd681700-3cfd-4fdc-bcbc-13540e804ffc None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:51.364232 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 389/782] 10.222.0.25 () {56 vars in 1126 bytes} [Wed May 25 07:57:51 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:51.373996 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b15004-bdf5-4035-8587-c5a7b2034beb None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:51.548651 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b15004-bdf5-4035-8587-c5a7b2034beb None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:51.601265 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:51.611956 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba3f449-dc63-4c6d-8bad-065e43c47ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:51.613140 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3f449-dc63-4c6d-8bad-065e43c47ec4 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:51.613641 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3f449-dc63-4c6d-8bad-065e43c47ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:51.614136 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba3f449-dc63-4c6d-8bad-065e43c47ec4 None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:51.615442 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3f449-dc63-4c6d-8bad-065e43c47ec4 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:51.615991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3f449-dc63-4c6d-8bad-065e43c47ec4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:51.622270 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba3f449-dc63-4c6d-8bad-065e43c47ec4 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:51.631014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 394/783] 10.222.0.25 () {56 vars in 1126 bytes} [Wed May 25 07:57:51 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:51.641826 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681700-3cfd-4fdc-bcbc-13540e804ffc None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:51.791141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd681700-3cfd-4fdc-bcbc-13540e804ffc None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:51.847398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29582ccc-f8eb-418d-aa9c-a66d29c4c6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:51.848579 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582ccc-f8eb-418d-aa9c-a66d29c4c6c9 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:51.849091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582ccc-f8eb-418d-aa9c-a66d29c4c6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:51.849587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29582ccc-f8eb-418d-aa9c-a66d29c4c6c9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:51.851005 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29582ccc-f8eb-418d-aa9c-a66d29c4c6c9 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:51.853685 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29582ccc-f8eb-418d-aa9c-a66d29c4c6c9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:51.854825 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf0e52-2b26-48da-bca4-d9d81a09fc5e None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:51.855307 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf0e52-2b26-48da-bca4-d9d81a09fc5e None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:51.855555 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcf0e52-2b26-48da-bca4-d9d81a09fc5e None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:51.857151 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 395/784] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:57:51.863485 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e111ffe-dede-4cc7-a2d0-5832a454b5a7 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:51.863760 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e111ffe-dede-4cc7-a2d0-5832a454b5a7 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:51.864051 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e111ffe-dede-4cc7-a2d0-5832a454b5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:51.883678 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-9e111ffe-dede-4cc7-a2d0-5832a454b5a7 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:51.884981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-9e111ffe-dede-4cc7-a2d0-5832a454b5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:51.886441 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 390/785] 10.222.0.25 () {60 vars in 1144 bytes} [Wed May 25 07:57:51 2022] POST /identity/v3/endpoints => generated 347 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:57:52.029392 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 396/786] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:51 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:57:52.055402 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29582ccc-f8eb-418d-aa9c-a66d29c4c6c9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:52.122640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:52.214216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29582ccc-f8eb-418d-aa9c-a66d29c4c6c9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:52.262065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d1595-c444-46ad-87ee-55587998cb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:52.263006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d1595-c444-46ad-87ee-55587998cb1e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:52.263414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d1595-c444-46ad-87ee-55587998cb1e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:52.263789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671d1595-c444-46ad-87ee-55587998cb1e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:52.264913 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d1595-c444-46ad-87ee-55587998cb1e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:52.266552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671d1595-c444-46ad-87ee-55587998cb1e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-671d1595-c444-46ad-87ee-55587998cb1e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:52.280308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:52.289065 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:52.291259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 391/787] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:57:52 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:52.295016 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e111ffe-dede-4cc7-a2d0-5832a454b5a7 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:52.469131 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e111ffe-dede-4cc7-a2d0-5832a454b5a7 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:52.498852 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:52.516469 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e195bc0-1f5a-4f82-8891-79a23be7491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:52.517180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e195bc0-1f5a-4f82-8891-79a23be7491f None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:52.517482 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e195bc0-1f5a-4f82-8891-79a23be7491f None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:52.517755 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e195bc0-1f5a-4f82-8891-79a23be7491f None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:52.518507 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e195bc0-1f5a-4f82-8891-79a23be7491f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:52.518818 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e195bc0-1f5a-4f82-8891-79a23be7491f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:52.520335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e195bc0-1f5a-4f82-8891-79a23be7491f None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:52.527001 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 397/788] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:57:52 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:52.535618 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d1595-c444-46ad-87ee-55587998cb1e None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:52.653164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671d1595-c444-46ad-87ee-55587998cb1e None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:52.670144 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:52.698905 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62027d7-a181-4665-910c-597a09c9856e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:52.699888 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62027d7-a181-4665-910c-597a09c9856e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:52.700213 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62027d7-a181-4665-910c-597a09c9856e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:52.700511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62027d7-a181-4665-910c-597a09c9856e None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:52.701252 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62027d7-a181-4665-910c-597a09c9856e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:52.701540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62027d7-a181-4665-910c-597a09c9856e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:52.703324 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62027d7-a181-4665-910c-597a09c9856e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:52.709296 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 392/789] 10.222.0.25 () {56 vars in 1114 bytes} [Wed May 25 07:57:52 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:52.716601 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e195bc0-1f5a-4f82-8891-79a23be7491f None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:52.847782 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e195bc0-1f5a-4f82-8891-79a23be7491f None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:52.884705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9ab821-907d-43d0-8a5a-a8af88ddfa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:52.885425 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ab821-907d-43d0-8a5a-a8af88ddfa74 None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:52.885633 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ab821-907d-43d0-8a5a-a8af88ddfa74 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:52.885906 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9ab821-907d-43d0-8a5a-a8af88ddfa74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:52.886668 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ab821-907d-43d0-8a5a-a8af88ddfa74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:52.888059 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9ab821-907d-43d0-8a5a-a8af88ddfa74 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:52.911853 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 398/790] 10.222.0.25 () {60 vars in 1144 bytes} [Wed May 25 07:57:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:57:54.321299 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b371e4-94a4-4a70-bc72-40178fab0855 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:54.321860 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b371e4-94a4-4a70-bc72-40178fab0855 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:54.321860 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b371e4-94a4-4a70-bc72-40178fab0855 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:54.323125 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 393/791] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:54.328978 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1e86c-69e0-4404-ae22-959fe177f67c None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:54.329775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1e86c-69e0-4404-ae22-959fe177f67c None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:54.329994 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a1e86c-69e0-4404-ae22-959fe177f67c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:54.353055 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-32a1e86c-69e0-4404-ae22-959fe177f67c None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:54.354278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-32a1e86c-69e0-4404-ae22-959fe177f67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:54.394497 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:54.436864 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 399/792] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:54 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:57:54.460545 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b371e4-94a4-4a70-bc72-40178fab0855 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:54.575493 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b371e4-94a4-4a70-bc72-40178fab0855 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:54.613981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d24316-deff-4c8f-8840-b513d166bfdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:54.614797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d24316-deff-4c8f-8840-b513d166bfdd None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:54.615085 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d24316-deff-4c8f-8840-b513d166bfdd None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:54.615360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d24316-deff-4c8f-8840-b513d166bfdd None admin] PATH_INFO: `/v3/services/compute` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:54.616048 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d24316-deff-4c8f-8840-b513d166bfdd None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:54.617564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d24316-deff-4c8f-8840-b513d166bfdd None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-35d24316-deff-4c8f-8840-b513d166bfdd None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:54.630249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:54.632476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:54.634994 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 394/793] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:54.641640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1e86c-69e0-4404-ae22-959fe177f67c None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:54.760083 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a1e86c-69e0-4404-ae22-959fe177f67c None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:54.803181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151cf64a-72a8-401a-90de-258c05a3959f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:54.803936 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cf64a-72a8-401a-90de-258c05a3959f None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:54.804316 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cf64a-72a8-401a-90de-258c05a3959f None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:54.804696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151cf64a-72a8-401a-90de-258c05a3959f None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:54.806072 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cf64a-72a8-401a-90de-258c05a3959f None admin] RBAC: Adding query filter params (name=compute) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:54.806426 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cf64a-72a8-401a-90de-258c05a3959f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:54.807953 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151cf64a-72a8-401a-90de-258c05a3959f None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:54.813981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 400/794] 10.222.0.25 () {56 vars in 1112 bytes} [Wed May 25 07:57:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:54.820823 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d24316-deff-4c8f-8840-b513d166bfdd None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:54.867619 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:54.932272 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d24316-deff-4c8f-8840-b513d166bfdd None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:54.970439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31628d5-daf0-4c9f-858e-6fa122171622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:54.971104 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31628d5-daf0-4c9f-858e-6fa122171622 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:54.971387 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31628d5-daf0-4c9f-858e-6fa122171622 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:54.971660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31628d5-daf0-4c9f-858e-6fa122171622 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:54.972530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31628d5-daf0-4c9f-858e-6fa122171622 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:54.972833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31628d5-daf0-4c9f-858e-6fa122171622 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:54.974212 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31628d5-daf0-4c9f-858e-6fa122171622 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:54.979135 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 395/795] 10.222.0.25 () {56 vars in 1112 bytes} [Wed May 25 07:57:54 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:57:56.164855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a846-265b-48d2-8518-61cc72d3c24d None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:56.165514 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a846-265b-48d2-8518-61cc72d3c24d None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:56.165514 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb4a846-265b-48d2-8518-61cc72d3c24d None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:56.166959 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 401/796] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:56.174011 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350da4af-79fe-4a60-8960-15d92b3be32c None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:56.174570 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350da4af-79fe-4a60-8960-15d92b3be32c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:56.174993 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350da4af-79fe-4a60-8960-15d92b3be32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:56.203467 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-350da4af-79fe-4a60-8960-15d92b3be32c None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:56.205558 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-350da4af-79fe-4a60-8960-15d92b3be32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:56.327236 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 396/797] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:56 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:57:56.353816 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4a846-265b-48d2-8518-61cc72d3c24d None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:56.388577 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:56.472186 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb4a846-265b-48d2-8518-61cc72d3c24d None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:56.523203 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aecdce-c564-4854-8daf-fb0bfd91f3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:56.524926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aecdce-c564-4854-8daf-fb0bfd91f3b8 None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:56.525440 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aecdce-c564-4854-8daf-fb0bfd91f3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:56.525967 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89aecdce-c564-4854-8daf-fb0bfd91f3b8 None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:56.527334 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aecdce-c564-4854-8daf-fb0bfd91f3b8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:56.530147 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89aecdce-c564-4854-8daf-fb0bfd91f3b8 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:56.532879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: WARNING keystone.server.flask.common [None req-89aecdce-c564-4854-8daf-fb0bfd91f3b8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 25 07:57:56.562966 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.sql.core [None req-89aecdce-c564-4854-8daf-fb0bfd91f3b8 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 07:57:56.562966 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 07:57:56.562966 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [parameters: {'id': '2c396100a5b64c0c8db9f55103a233bb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 07:57:56.562966 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87084) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 07:57:56.596153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-89aecdce-c564-4854-8daf-fb0bfd91f3b8 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c396100a5b64c0c8db9f55103a233bb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c396100a5b64c0c8db9f55103a233bb. May 25 07:57:56.596153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:56.596153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 07:57:56.596153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 07:57:56.596153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 07:57:56.596153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 07:57:56.596153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 07:57:56.596153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application result = self._query(query) May 25 07:57:56.596153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 07:57:56.596153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application conn.query(q) May 25 07:57:56.596153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 07:57:56.596153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 07:57:56.596153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application result.read() May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 25 07:57:56.597811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return project_ref.to_dict() May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application next(self.gen) May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application yield resource May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application next(self.gen) May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self.session.rollback() May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self.force_reraise() May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise self.value May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application session.commit() May 25 07:57:56.605854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._prepare_impl() May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self.session.flush() May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._flush(objects) May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application compat.raise_( May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application flush_context.execute() May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 07:57:56.607710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rec.execute(self) May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application c = connection._execute_20( May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 07:57:56.609696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application result = self._query(query) May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application conn.query(q) May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application result.read() May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 07:57:56.611476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [parameters: {'id': '2c396100a5b64c0c8db9f55103a233bb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:56.613356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:56.614947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:56.616778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:56.616778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 25 07:57:56.616778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 25 07:57:56.616778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:56.616778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:56.616778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 25 07:57:56.616778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.Conflict( May 25 07:57:56.616778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 2c396100a5b64c0c8db9f55103a233bb. May 25 07:57:56.616778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:56.616778 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 402/798] 10.222.0.25 () {60 vars in 1140 bytes} [Wed May 25 07:57:56 2022] POST /identity/v3/projects => generated 262 bytes in 246 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:56.617904 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350da4af-79fe-4a60-8960-15d92b3be32c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:56.662502 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:56.744210 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350da4af-79fe-4a60-8960-15d92b3be32c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:56.802734 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42c6ed7-f6e8-4efa-b26d-fa8f5b3c0864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:56.803545 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6ed7-f6e8-4efa-b26d-fa8f5b3c0864 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:56.803854 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6ed7-f6e8-4efa-b26d-fa8f5b3c0864 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:56.804142 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42c6ed7-f6e8-4efa-b26d-fa8f5b3c0864 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:56.812627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c6ed7-f6e8-4efa-b26d-fa8f5b3c0864 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:56.814098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42c6ed7-f6e8-4efa-b26d-fa8f5b3c0864 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-d42c6ed7-f6e8-4efa-b26d-fa8f5b3c0864 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:57:56.829422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:57:56.831079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:57:56.832968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:57:56.832968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:57:56.832968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:57:56.832968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:57:56.832968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:57:56.832968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:57:56.832968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:57:56.832968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:57:56.832968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 397/799] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:57:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:56.837054 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aecdce-c564-4854-8daf-fb0bfd91f3b8 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:56.953153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:56.982700 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89aecdce-c564-4854-8daf-fb0bfd91f3b8 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:57.040278 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a76795d-b67b-4d0f-ba96-ade7b9ce7bf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:57.041062 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76795d-b67b-4d0f-ba96-ade7b9ce7bf0 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:57.041444 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76795d-b67b-4d0f-ba96-ade7b9ce7bf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:57.041834 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a76795d-b67b-4d0f-ba96-ade7b9ce7bf0 None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:57.042745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76795d-b67b-4d0f-ba96-ade7b9ce7bf0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:57:57.043149 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76795d-b67b-4d0f-ba96-ade7b9ce7bf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:57.045056 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a76795d-b67b-4d0f-ba96-ade7b9ce7bf0 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:57.072695 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 403/800] 10.222.0.25 () {56 vars in 1112 bytes} [Wed May 25 07:57:56 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:57:57.442680 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f278e-200e-465b-ad35-01b11bbfaf5b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:57.443269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f278e-200e-465b-ad35-01b11bbfaf5b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:57.443651 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004f278e-200e-465b-ad35-01b11bbfaf5b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:57.446378 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 398/801] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:57.454751 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb75b7-8e1b-408a-80f7-1bdb141f56d7 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:57.455543 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb75b7-8e1b-408a-80f7-1bdb141f56d7 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:57.455836 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb75b7-8e1b-408a-80f7-1bdb141f56d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:57.475895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-aecb75b7-8e1b-408a-80f7-1bdb141f56d7 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:57.478794 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-aecb75b7-8e1b-408a-80f7-1bdb141f56d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:57.561799 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 404/802] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:57 2022] POST /identity/v3/auth/tokens => generated 1607 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:57:57.586513 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f278e-200e-465b-ad35-01b11bbfaf5b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:57.698890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:57.706880 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004f278e-200e-465b-ad35-01b11bbfaf5b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:57.754032 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96a049f-6745-4b26-9be4-a7c406db8a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:57.754884 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a049f-6745-4b26-9be4-a7c406db8a3f None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:57.755281 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a049f-6745-4b26-9be4-a7c406db8a3f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:57.755672 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96a049f-6745-4b26-9be4-a7c406db8a3f None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:57.756593 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a049f-6745-4b26-9be4-a7c406db8a3f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:57.758679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96a049f-6745-4b26-9be4-a7c406db8a3f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:57.775215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 399/803] 10.222.0.25 () {60 vars in 1141 bytes} [Wed May 25 07:57:57 2022] POST /identity/v3/services => generated 242 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:57:59.503995 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff804970-f9b0-452f-94b1-97c30eda518a None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:59.504591 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff804970-f9b0-452f-94b1-97c30eda518a None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:59.504736 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff804970-f9b0-452f-94b1-97c30eda518a None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:59.506237 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 405/804] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:57:59.511989 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53853940-480b-4be6-84c3-4bb55ea25123 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:59.512512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53853940-480b-4be6-84c3-4bb55ea25123 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:59.512718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53853940-480b-4be6-84c3-4bb55ea25123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:59.531631 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-53853940-480b-4be6-84c3-4bb55ea25123 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:57:59.532895 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-53853940-480b-4be6-84c3-4bb55ea25123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:57:59.611712 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 400/805] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:57:59 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:57:59.639737 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff804970-f9b0-452f-94b1-97c30eda518a None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:59.736396 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:59.766500 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff804970-f9b0-452f-94b1-97c30eda518a None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:57:59.810106 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63170f0-64f7-47ef-a2ca-792c2d351e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:57:59.810788 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63170f0-64f7-47ef-a2ca-792c2d351e54 None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:57:59.811078 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63170f0-64f7-47ef-a2ca-792c2d351e54 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:57:59.811359 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63170f0-64f7-47ef-a2ca-792c2d351e54 None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:57:59.812096 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63170f0-64f7-47ef-a2ca-792c2d351e54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:57:59.813678 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63170f0-64f7-47ef-a2ca-792c2d351e54 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:57:59.828831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.sql.core [None req-e63170f0-64f7-47ef-a2ca-792c2d351e54 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 07:57:59.828831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 07:57:59.828831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [parameters: {'user_id': '9a8ed0a8c4274417b8f00151e17c3041', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 07:57:59.828831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87084) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-e63170f0-64f7-47ef-a2ca-792c2d351e54 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application result = self._query(query) May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application conn.query(q) May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application result.read() May 25 07:57:59.836879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 07:57:59.838919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application next(self.gen) May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application yield resource May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application next(self.gen) May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self.session.rollback() May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self.force_reraise() May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise self.value May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application session.commit() May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 25 07:57:59.841126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._prepare_impl() May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self.session.flush() May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._flush(objects) May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application compat.raise_( May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application flush_context.execute() May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rec.execute(self) May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 25 07:57:59.843321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application _emit_insert_statements( May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application result = connection._execute_20( May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ret = self._execute_context( May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 25 07:57:59.845221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self.dialect.do_execute( May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application result = self._query(query) May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application conn.query(q) May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application result.read() May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 25 07:57:59.847776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application packet.raise_for_error() May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [parameters: {'user_id': '9a8ed0a8c4274417b8f00151e17c3041', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:57:59.849669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 25 07:57:59.852184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 25 07:57:59.854439 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 25 07:57:59.854439 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 25 07:57:59.854439 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 25 07:57:59.854439 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 25 07:57:59.854439 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 25 07:57:59.854439 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:57:59.854439 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 406/806] 10.222.0.25 () {60 vars in 1131 bytes} [Wed May 25 07:57:59 2022] POST /identity/v3/users => generated 160 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 25 07:57:59.855310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53853940-480b-4be6-84c3-4bb55ea25123 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:57:59.948278 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:57:59.979621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53853940-480b-4be6-84c3-4bb55ea25123 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:58:00.036213 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba505f4-b86a-4ca3-ba5f-ce9b8adb1284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:58:00.037182 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba505f4-b86a-4ca3-ba5f-ce9b8adb1284 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:00.037585 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba505f4-b86a-4ca3-ba5f-ce9b8adb1284 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:00.037961 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba505f4-b86a-4ca3-ba5f-ce9b8adb1284 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:00.047873 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba505f4-b86a-4ca3-ba5f-ce9b8adb1284 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:58:00.049664 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba505f4-b86a-4ca3-ba5f-ce9b8adb1284 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-8ba505f4-b86a-4ca3-ba5f-ce9b8adb1284 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:58:00.066875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:58:00.068793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:58:00.070724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:58:00.070724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:58:00.070724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:58:00.070724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:58:00.070724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:58:00.070724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:58:00.070724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:58:00.070724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:58:00.070724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 25 07:58:00.070724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:58:00.070724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 401/807] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:57:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:58:00.075147 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63170f0-64f7-47ef-a2ca-792c2d351e54 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:58:00.260596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63170f0-64f7-47ef-a2ca-792c2d351e54 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:58:00.322101 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38671eb2-85de-45dd-af5b-abe2cbd9195c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:58:00.323205 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38671eb2-85de-45dd-af5b-abe2cbd9195c None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:00.323783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38671eb2-85de-45dd-af5b-abe2cbd9195c None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:00.324338 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38671eb2-85de-45dd-af5b-abe2cbd9195c None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:00.325954 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38671eb2-85de-45dd-af5b-abe2cbd9195c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:58:00.326524 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38671eb2-85de-45dd-af5b-abe2cbd9195c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:58:00.329842 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38671eb2-85de-45dd-af5b-abe2cbd9195c None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:58:00.364971 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:58:00.401763 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 407/808] 10.222.0.25 () {56 vars in 1101 bytes} [Wed May 25 07:58:00 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:58:00.929163 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff713949-7223-463c-9043-7a91ad59e011 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:00.929880 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff713949-7223-463c-9043-7a91ad59e011 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:00.929880 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff713949-7223-463c-9043-7a91ad59e011 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:00.931192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 402/809] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:58:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:58:00.939337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa3839-7954-44af-82da-54283c9ef50f None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:00.939856 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa3839-7954-44af-82da-54283c9ef50f None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:00.940303 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6aa3839-7954-44af-82da-54283c9ef50f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:00.968953 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-b6aa3839-7954-44af-82da-54283c9ef50f None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:58:00.971325 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-b6aa3839-7954-44af-82da-54283c9ef50f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:58:01.064252 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 408/810] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:58:00 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:58:01.103537 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff713949-7223-463c-9043-7a91ad59e011 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:58:01.219318 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff713949-7223-463c-9043-7a91ad59e011 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:58:01.258948 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851d7c-4acf-4d91-983a-9e58cc886049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:58:01.259830 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851d7c-4acf-4d91-983a-9e58cc886049 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:01.260349 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851d7c-4acf-4d91-983a-9e58cc886049 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:01.260699 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb851d7c-4acf-4d91-983a-9e58cc886049 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:01.261426 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb851d7c-4acf-4d91-983a-9e58cc886049 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:58:01.262921 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb851d7c-4acf-4d91-983a-9e58cc886049 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-bb851d7c-4acf-4d91-983a-9e58cc886049 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:58:01.276459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:58:01.278282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:58:01.280034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 403/811] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:58:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:58:01.286862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa3839-7954-44af-82da-54283c9ef50f None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:58:01.442637 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6aa3839-7954-44af-82da-54283c9ef50f None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:58:01.485304 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:58:01.495641 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419c551-3232-42fe-b4fa-2a3d6954725f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:58:01.496452 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419c551-3232-42fe-b4fa-2a3d6954725f None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:01.496779 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419c551-3232-42fe-b4fa-2a3d6954725f None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:01.497098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5419c551-3232-42fe-b4fa-2a3d6954725f None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:01.497871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419c551-3232-42fe-b4fa-2a3d6954725f None admin] RBAC: Adding query filter params (name=compute) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:58:01.498225 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419c551-3232-42fe-b4fa-2a3d6954725f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:58:01.499680 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5419c551-3232-42fe-b4fa-2a3d6954725f None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:58:01.505217 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 409/812] 10.222.0.25 () {56 vars in 1112 bytes} [Wed May 25 07:58:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:58:01.511620 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851d7c-4acf-4d91-983a-9e58cc886049 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:58:01.521536 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:58:01.620381 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb851d7c-4acf-4d91-983a-9e58cc886049 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:58:01.656704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45931d-429a-4f5e-ad21-bc5555642be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:58:01.657377 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45931d-429a-4f5e-ad21-bc5555642be9 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:01.657655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45931d-429a-4f5e-ad21-bc5555642be9 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:01.657926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd45931d-429a-4f5e-ad21-bc5555642be9 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:01.658634 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45931d-429a-4f5e-ad21-bc5555642be9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:58:01.658938 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45931d-429a-4f5e-ad21-bc5555642be9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:58:01.660349 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd45931d-429a-4f5e-ad21-bc5555642be9 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:58:01.665714 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 404/813] 10.222.0.25 () {56 vars in 1112 bytes} [Wed May 25 07:58:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:58:01.671970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419c551-3232-42fe-b4fa-2a3d6954725f None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:58:01.804633 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5419c551-3232-42fe-b4fa-2a3d6954725f None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:58:01.863708 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473186f2-d0e4-49ed-8161-cc896d6048d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:58:01.864891 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473186f2-d0e4-49ed-8161-cc896d6048d2 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:01.865408 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473186f2-d0e4-49ed-8161-cc896d6048d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:01.865919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473186f2-d0e4-49ed-8161-cc896d6048d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:01.867523 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473186f2-d0e4-49ed-8161-cc896d6048d2 None admin] RBAC: Adding query filter params (interface=public, service_id=909dd191bf6f44d084deec323b4ffcaf, region_id=RegionOne) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:58:01.868097 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473186f2-d0e4-49ed-8161-cc896d6048d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:58:01.870768 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473186f2-d0e4-49ed-8161-cc896d6048d2 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:58:01.880701 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 410/814] 10.222.0.25 () {56 vars in 1251 bytes} [Wed May 25 07:58:01 2022] GET /identity/v3/endpoints?service_id=909dd191bf6f44d084deec323b4ffcaf&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:58:01.887432 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45931d-429a-4f5e-ad21-bc5555642be9 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:58:01.964500 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:58:01.997002 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd45931d-429a-4f5e-ad21-bc5555642be9 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:58:02.032386 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931cb38-94fb-45e2-8b40-8f8cfc530d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:58:02.033109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931cb38-94fb-45e2-8b40-8f8cfc530d8c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:02.033436 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931cb38-94fb-45e2-8b40-8f8cfc530d8c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:02.033758 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931cb38-94fb-45e2-8b40-8f8cfc530d8c None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:02.034488 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931cb38-94fb-45e2-8b40-8f8cfc530d8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:58:02.035923 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931cb38-94fb-45e2-8b40-8f8cfc530d8c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:58:02.043417 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 405/815] 10.222.0.25 () {56 vars in 1087 bytes} [Wed May 25 07:58:01 2022] GET /identity/v3/services => generated 1728 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 07:58:04.381767 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ff7d-56ef-4200-bba0-02257872e8d7 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:04.382872 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ff7d-56ef-4200-bba0-02257872e8d7 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:04.382872 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae2ff7d-56ef-4200-bba0-02257872e8d7 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:04.384245 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 411/816] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:58:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 07:58:04.393014 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3237a03-4483-4bc8-ac8e-8a6728556ea3 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:04.393825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3237a03-4483-4bc8-ac8e-8a6728556ea3 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:04.394007 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3237a03-4483-4bc8-ac8e-8a6728556ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:04.412653 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-c3237a03-4483-4bc8-ac8e-8a6728556ea3 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:58:04.413907 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-c3237a03-4483-4bc8-ac8e-8a6728556ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:58:04.493201 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 406/817] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:58:04 2022] POST /identity/v3/auth/tokens => generated 1703 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:58:04.519103 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2ff7d-56ef-4200-bba0-02257872e8d7 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:58:04.581698 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:58:04.634969 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae2ff7d-56ef-4200-bba0-02257872e8d7 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:58:04.674747 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b5ba4-10b4-48cc-81d3-cce031826d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:58:04.675576 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b5ba4-10b4-48cc-81d3-cce031826d96 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:04.675866 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b5ba4-10b4-48cc-81d3-cce031826d96 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:04.676177 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677b5ba4-10b4-48cc-81d3-cce031826d96 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:04.676865 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b5ba4-10b4-48cc-81d3-cce031826d96 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:58:04.678332 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-677b5ba4-10b4-48cc-81d3-cce031826d96 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-677b5ba4-10b4-48cc-81d3-cce031826d96 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:58:04.691474 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:58:04.693432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:58:04.695553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 412/818] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:58:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:58:04.701301 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3237a03-4483-4bc8-ac8e-8a6728556ea3 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:58:04.775656 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:58:04.829446 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3237a03-4483-4bc8-ac8e-8a6728556ea3 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:58:04.867930 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9ff42-5777-472f-ab1b-3ca95d0d8272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:58:04.868632 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9ff42-5777-472f-ab1b-3ca95d0d8272 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:04.868913 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9ff42-5777-472f-ab1b-3ca95d0d8272 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:04.869185 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf9ff42-5777-472f-ab1b-3ca95d0d8272 None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:04.869910 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9ff42-5777-472f-ab1b-3ca95d0d8272 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:58:04.870214 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9ff42-5777-472f-ab1b-3ca95d0d8272 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:58:04.871611 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf9ff42-5777-472f-ab1b-3ca95d0d8272 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:58:04.877273 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 407/819] 10.222.0.25 () {56 vars in 1112 bytes} [Wed May 25 07:58:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:58:04.883313 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b5ba4-10b4-48cc-81d3-cce031826d96 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:58:05.014978 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677b5ba4-10b4-48cc-81d3-cce031826d96 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:58:05.033955 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:58:05.055728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac12499-5b37-4219-bca8-73211ff2bd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:58:05.056439 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac12499-5b37-4219-bca8-73211ff2bd93 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:05.056727 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac12499-5b37-4219-bca8-73211ff2bd93 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:05.057005 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac12499-5b37-4219-bca8-73211ff2bd93 None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:05.057717 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac12499-5b37-4219-bca8-73211ff2bd93 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:58:05.058028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac12499-5b37-4219-bca8-73211ff2bd93 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:58:05.059406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac12499-5b37-4219-bca8-73211ff2bd93 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:58:05.064696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 413/820] 10.222.0.25 () {56 vars in 1112 bytes} [Wed May 25 07:58:04 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:58:05.070480 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9ff42-5777-472f-ab1b-3ca95d0d8272 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:58:05.182869 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf9ff42-5777-472f-ab1b-3ca95d0d8272 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:58:05.224404 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:58:05.238404 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53e32c89-49bc-40ba-a0d2-1c4a465d7c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:58:05.239546 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e32c89-49bc-40ba-a0d2-1c4a465d7c3b None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:58:05.240074 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e32c89-49bc-40ba-a0d2-1c4a465d7c3b None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:58:05.240915 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53e32c89-49bc-40ba-a0d2-1c4a465d7c3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:58:05.242663 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e32c89-49bc-40ba-a0d2-1c4a465d7c3b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:58:05.245368 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53e32c89-49bc-40ba-a0d2-1c4a465d7c3b None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:58:05.267574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 408/821] 10.222.0.25 () {60 vars in 1144 bytes} [Wed May 25 07:58:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 07:58:15.062241 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=9 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:58:15.262836 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=7,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:08.411422 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c80fc-1456-4386-ba0e-6095eb8a0a11 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:08.412046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c80fc-1456-4386-ba0e-6095eb8a0a11 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:08.412046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5c80fc-1456-4386-ba0e-6095eb8a0a11 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:08.413698 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 414/822] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:59:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:59:08.421164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416f302-2db4-4e43-aea6-865addd60b2d None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:08.421683 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416f302-2db4-4e43-aea6-865addd60b2d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:08.421683 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416f302-2db4-4e43-aea6-865addd60b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:08.444040 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-2416f302-2db4-4e43-aea6-865addd60b2d None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:59:08.445431 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-2416f302-2db4-4e43-aea6-865addd60b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:59:08.537741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 409/823] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:59:08 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:59:08.568594 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c80fc-1456-4386-ba0e-6095eb8a0a11 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:08.704018 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5c80fc-1456-4386-ba0e-6095eb8a0a11 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:08.746973 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3244231-86e3-4b58-b8a4-0439f377f3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:08.747790 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3244231-86e3-4b58-b8a4-0439f377f3e5 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:08.748175 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3244231-86e3-4b58-b8a4-0439f377f3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:08.748394 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3244231-86e3-4b58-b8a4-0439f377f3e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:08.760166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3244231-86e3-4b58-b8a4-0439f377f3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:08.761656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3244231-86e3-4b58-b8a4-0439f377f3e5 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-c3244231-86e3-4b58-b8a4-0439f377f3e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:59:08.786581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:08.787814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:08.788813 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:59:08.788813 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:59:08.788813 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:08.788813 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:08.788813 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 415/824] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:59:08.794055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416f302-2db4-4e43-aea6-865addd60b2d None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:08.920603 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416f302-2db4-4e43-aea6-865addd60b2d None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:08.955382 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:08.966250 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72aefc1-1d0b-45a1-a41f-217a3786c32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:08.967108 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aefc1-1d0b-45a1-a41f-217a3786c32e None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:08.967481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aefc1-1d0b-45a1-a41f-217a3786c32e None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:08.967787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72aefc1-1d0b-45a1-a41f-217a3786c32e None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:08.968647 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72aefc1-1d0b-45a1-a41f-217a3786c32e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:08.969032 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72aefc1-1d0b-45a1-a41f-217a3786c32e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:08.970672 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72aefc1-1d0b-45a1-a41f-217a3786c32e None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:08.986801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 410/825] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:59:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:08.994074 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3244231-86e3-4b58-b8a4-0439f377f3e5 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:09.063837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:09.127142 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3244231-86e3-4b58-b8a4-0439f377f3e5 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:09.170435 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59126be0-03ae-4473-9cf2-a4b7a8dbc9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:09.171156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59126be0-03ae-4473-9cf2-a4b7a8dbc9c0 None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:09.171436 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59126be0-03ae-4473-9cf2-a4b7a8dbc9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:09.171716 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59126be0-03ae-4473-9cf2-a4b7a8dbc9c0 None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:09.172477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59126be0-03ae-4473-9cf2-a4b7a8dbc9c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:09.173899 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59126be0-03ae-4473-9cf2-a4b7a8dbc9c0 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:09.199489 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 416/826] 10.222.0.25 () {60 vars in 1132 bytes} [Wed May 25 07:59:08 2022] POST /identity/v3/users => generated 251 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:59:11.860153 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aff133-cf6f-4c22-92c0-e4085605bb8f None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:11.860728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aff133-cf6f-4c22-92c0-e4085605bb8f None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:11.860824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aff133-cf6f-4c22-92c0-e4085605bb8f None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:11.862365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 411/827] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:59:11.868011 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bddd0b-51b0-4be2-a361-1bbd6b044f13 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:11.868528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bddd0b-51b0-4be2-a361-1bbd6b044f13 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:11.868631 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bddd0b-51b0-4be2-a361-1bbd6b044f13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:11.886427 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-32bddd0b-51b0-4be2-a361-1bbd6b044f13 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:59:11.887669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-32bddd0b-51b0-4be2-a361-1bbd6b044f13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:59:11.966276 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 417/828] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:59:11 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:59:11.992098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aff133-cf6f-4c22-92c0-e4085605bb8f None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:12.110545 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aff133-cf6f-4c22-92c0-e4085605bb8f None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:12.152013 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c917f0d-9fdd-4fa1-87b4-41d6fd763fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:12.152865 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c917f0d-9fdd-4fa1-87b4-41d6fd763fea None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:12.153151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c917f0d-9fdd-4fa1-87b4-41d6fd763fea None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:12.153438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c917f0d-9fdd-4fa1-87b4-41d6fd763fea None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:12.165936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c917f0d-9fdd-4fa1-87b4-41d6fd763fea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-1c917f0d-9fdd-4fa1-87b4-41d6fd763fea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:59:12.174587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:12.177196 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:12.178297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:12.178297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:12.178297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:12.178297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:12.178297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:59:12.178297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:59:12.178297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:59:12.178297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:59:12.178297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:59:12.178297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:59:12.178297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:59:12.178297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:12.178297 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 412/829] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:59:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:12.183331 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bddd0b-51b0-4be2-a361-1bbd6b044f13 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:12.228167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:12.294746 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bddd0b-51b0-4be2-a361-1bbd6b044f13 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:12.334286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e873c-ed7c-4451-88bd-b0425b99dfeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:12.335106 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e873c-ed7c-4451-88bd-b0425b99dfeb None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:12.335430 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e873c-ed7c-4451-88bd-b0425b99dfeb None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:12.335771 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e873c-ed7c-4451-88bd-b0425b99dfeb None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:12.336612 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e873c-ed7c-4451-88bd-b0425b99dfeb None admin] RBAC: Adding query filter params (name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:12.337129 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e873c-ed7c-4451-88bd-b0425b99dfeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:12.338627 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e873c-ed7c-4451-88bd-b0425b99dfeb None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:12.347305 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 418/830] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:59:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:12.354600 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c917f0d-9fdd-4fa1-87b4-41d6fd763fea None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:12.411515 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:12.482012 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c917f0d-9fdd-4fa1-87b4-41d6fd763fea None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:12.527814 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3993d5-5578-4e2a-866c-12ef1f51b15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:12.528927 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3993d5-5578-4e2a-866c-12ef1f51b15a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:12.529137 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3993d5-5578-4e2a-866c-12ef1f51b15a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:12.529453 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3993d5-5578-4e2a-866c-12ef1f51b15a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:12.543632 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3993d5-5578-4e2a-866c-12ef1f51b15a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:12.545474 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3993d5-5578-4e2a-866c-12ef1f51b15a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-be3993d5-5578-4e2a-866c-12ef1f51b15a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:59:12.564671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:12.565926 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:12.567042 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:59:12.567042 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:59:12.567042 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:12.567042 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:12.567042 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 413/831] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:12.572145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e873c-ed7c-4451-88bd-b0425b99dfeb None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:12.687063 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:12.690739 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e873c-ed7c-4451-88bd-b0425b99dfeb None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:12.730718 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84854c2f-65b6-4011-8c7e-51e54ddd31d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:12.731636 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854c2f-65b6-4011-8c7e-51e54ddd31d5 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:12.731636 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854c2f-65b6-4011-8c7e-51e54ddd31d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:12.731924 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84854c2f-65b6-4011-8c7e-51e54ddd31d5 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:12.732668 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84854c2f-65b6-4011-8c7e-51e54ddd31d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:12.732976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84854c2f-65b6-4011-8c7e-51e54ddd31d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:12.734347 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84854c2f-65b6-4011-8c7e-51e54ddd31d5 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:12.748809 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 419/832] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:59:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:12.755009 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3993d5-5578-4e2a-866c-12ef1f51b15a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:12.866529 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:12.871021 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3993d5-5578-4e2a-866c-12ef1f51b15a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:12.919451 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a46fc-ca49-44de-a7f5-9ccb7593fd66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:12.920412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a46fc-ca49-44de-a7f5-9ccb7593fd66 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:12.920700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a46fc-ca49-44de-a7f5-9ccb7593fd66 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:12.920981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7a46fc-ca49-44de-a7f5-9ccb7593fd66 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:12.930918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a46fc-ca49-44de-a7f5-9ccb7593fd66 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:12.932609 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7a46fc-ca49-44de-a7f5-9ccb7593fd66 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-cf7a46fc-ca49-44de-a7f5-9ccb7593fd66 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:59:12.950164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:12.951376 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:12.952398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:12.952398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:12.952398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:59:12.952398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:59:12.952398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:59:12.952398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:59:12.952398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:59:12.952398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:59:12.952398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 07:59:12.952398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:12.952398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 414/833] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:12 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:12.958180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84854c2f-65b6-4011-8c7e-51e54ddd31d5 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:13.077041 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84854c2f-65b6-4011-8c7e-51e54ddd31d5 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:13.117909 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca47580-c387-49f3-b309-e1344fc038c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:13.118564 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca47580-c387-49f3-b309-e1344fc038c5 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:13.118842 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca47580-c387-49f3-b309-e1344fc038c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:13.119133 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca47580-c387-49f3-b309-e1344fc038c5 None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:13.119953 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca47580-c387-49f3-b309-e1344fc038c5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:13.120295 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca47580-c387-49f3-b309-e1344fc038c5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:13.121729 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca47580-c387-49f3-b309-e1344fc038c5 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:13.140263 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 420/834] 10.222.0.25 () {56 vars in 1143 bytes} [Wed May 25 07:59:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:13.146281 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a46fc-ca49-44de-a7f5-9ccb7593fd66 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:13.260929 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7a46fc-ca49-44de-a7f5-9ccb7593fd66 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:13.296687 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525e5b6-55ac-44e6-823e-c906d7dfb9f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:13.297340 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525e5b6-55ac-44e6-823e-c906d7dfb9f0 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:13.297633 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525e5b6-55ac-44e6-823e-c906d7dfb9f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:13.297914 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7525e5b6-55ac-44e6-823e-c906d7dfb9f0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:13.329794 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:13.378508 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525e5b6-55ac-44e6-823e-c906d7dfb9f0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:13.379938 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7525e5b6-55ac-44e6-823e-c906d7dfb9f0 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:13.500569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 415/835] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:59:13 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:59:13.506519 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca47580-c387-49f3-b309-e1344fc038c5 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:13.527194 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:13.625096 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca47580-c387-49f3-b309-e1344fc038c5 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:13.662420 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862f6ed-8d8a-445c-a15d-b8386c987807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:13.663249 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862f6ed-8d8a-445c-a15d-b8386c987807 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:13.663532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862f6ed-8d8a-445c-a15d-b8386c987807 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:13.663808 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862f6ed-8d8a-445c-a15d-b8386c987807 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:13.674848 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862f6ed-8d8a-445c-a15d-b8386c987807 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:13.676900 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862f6ed-8d8a-445c-a15d-b8386c987807 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-5862f6ed-8d8a-445c-a15d-b8386c987807 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:59:13.694991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:13.696509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:13.697661 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:59:13.697661 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:59:13.697661 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:13.697661 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:13.697661 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 421/836] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:59:13.702258 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525e5b6-55ac-44e6-823e-c906d7dfb9f0 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:13.768671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:13.826532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7525e5b6-55ac-44e6-823e-c906d7dfb9f0 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:13.873163 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e91708-0a98-4470-bf25-9ebe249ac0ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:13.873938 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e91708-0a98-4470-bf25-9ebe249ac0ae None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:13.874170 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e91708-0a98-4470-bf25-9ebe249ac0ae None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:13.874433 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e91708-0a98-4470-bf25-9ebe249ac0ae None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:13.875180 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e91708-0a98-4470-bf25-9ebe249ac0ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:13.875509 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e91708-0a98-4470-bf25-9ebe249ac0ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:13.876966 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e91708-0a98-4470-bf25-9ebe249ac0ae None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:13.890493 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 416/837] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:59:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:13.896915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862f6ed-8d8a-445c-a15d-b8386c987807 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:13.976827 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:14.014976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862f6ed-8d8a-445c-a15d-b8386c987807 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:14.054756 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b85a4a-cb94-41d9-aa8c-7b165cca802d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:14.055561 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b85a4a-cb94-41d9-aa8c-7b165cca802d None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:14.055890 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b85a4a-cb94-41d9-aa8c-7b165cca802d None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:14.056130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b85a4a-cb94-41d9-aa8c-7b165cca802d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:14.063606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b85a4a-cb94-41d9-aa8c-7b165cca802d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:14.065136 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b85a4a-cb94-41d9-aa8c-7b165cca802d None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-a7b85a4a-cb94-41d9-aa8c-7b165cca802d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:59:14.080156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:14.081288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:14.082933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:59:14.082933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:59:14.082933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:59:14.082933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:59:14.082933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:59:14.082933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:59:14.082933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:59:14.082933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:14.084486 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 422/838] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:59:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:59:14.087720 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e91708-0a98-4470-bf25-9ebe249ac0ae None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:14.217461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e91708-0a98-4470-bf25-9ebe249ac0ae None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:14.238797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:14.258862 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cff01e-cb94-4e45-bdd5-d4c13191fbf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:14.259585 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cff01e-cb94-4e45-bdd5-d4c13191fbf0 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:14.259914 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cff01e-cb94-4e45-bdd5-d4c13191fbf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:14.260474 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cff01e-cb94-4e45-bdd5-d4c13191fbf0 None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:14.261887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cff01e-cb94-4e45-bdd5-d4c13191fbf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:14.262234 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cff01e-cb94-4e45-bdd5-d4c13191fbf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:14.264296 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cff01e-cb94-4e45-bdd5-d4c13191fbf0 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:14.280086 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 417/839] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:59:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:14.286375 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b85a4a-cb94-41d9-aa8c-7b165cca802d None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:14.410211 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b85a4a-cb94-41d9-aa8c-7b165cca802d None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:14.442617 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:14.449341 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f21d17-269d-4c5c-8d40-cec909b6466b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:14.450020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f21d17-269d-4c5c-8d40-cec909b6466b None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:14.450319 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f21d17-269d-4c5c-8d40-cec909b6466b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:14.450577 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f21d17-269d-4c5c-8d40-cec909b6466b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:14.451409 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f21d17-269d-4c5c-8d40-cec909b6466b None admin] RBAC: Adding query filter params (role.id=032121f695584aebbac76f0f8ca183fa, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=852fb6ed2a764a7db2c2497980c2e06f) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:14.451773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f21d17-269d-4c5c-8d40-cec909b6466b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:14.453213 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f21d17-269d-4c5c-8d40-cec909b6466b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:14.459537 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 423/840] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:59:14 2022] GET /identity/v3/role_assignments?user.id=852fb6ed2a764a7db2c2497980c2e06f&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=032121f695584aebbac76f0f8ca183fa => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:16.793418 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d839771-e490-4221-a5de-ca66eb83bd6e None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:16.793947 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d839771-e490-4221-a5de-ca66eb83bd6e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:16.793947 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d839771-e490-4221-a5de-ca66eb83bd6e None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:16.795335 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 418/841] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:59:16.800993 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e2d71-815c-4e8c-9c0a-dbed13675327 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:16.801444 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e2d71-815c-4e8c-9c0a-dbed13675327 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:16.801653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2e2d71-815c-4e8c-9c0a-dbed13675327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:16.819951 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-af2e2d71-815c-4e8c-9c0a-dbed13675327 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:59:16.821208 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-af2e2d71-815c-4e8c-9c0a-dbed13675327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:59:16.893631 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 424/842] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:59:16 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:59:16.921547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d839771-e490-4221-a5de-ca66eb83bd6e None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:17.042198 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d839771-e490-4221-a5de-ca66eb83bd6e None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:17.077443 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879db205-08f5-4c62-8f8f-ff6f4282b706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:17.078157 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879db205-08f5-4c62-8f8f-ff6f4282b706 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:17.078438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879db205-08f5-4c62-8f8f-ff6f4282b706 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:17.078709 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879db205-08f5-4c62-8f8f-ff6f4282b706 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:17.089800 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879db205-08f5-4c62-8f8f-ff6f4282b706 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-879db205-08f5-4c62-8f8f-ff6f4282b706 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:59:17.098215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:17.099449 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:17.100455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:17.100455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:17.100455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:17.100455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:17.100455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:59:17.100455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:59:17.100455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:59:17.100455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:59:17.100455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:59:17.100455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:59:17.100455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:59:17.100455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:17.100455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 419/843] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:59:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:17.105832 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e2d71-815c-4e8c-9c0a-dbed13675327 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:17.228053 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2e2d71-815c-4e8c-9c0a-dbed13675327 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:17.254389 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:17.266757 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ad95a-ba4f-425d-98a6-9329d5158b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:17.267437 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ad95a-ba4f-425d-98a6-9329d5158b93 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:17.267719 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ad95a-ba4f-425d-98a6-9329d5158b93 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:17.267996 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68ad95a-ba4f-425d-98a6-9329d5158b93 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:17.268863 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ad95a-ba4f-425d-98a6-9329d5158b93 None admin] RBAC: Adding query filter params (name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:17.269172 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ad95a-ba4f-425d-98a6-9329d5158b93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:17.270656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68ad95a-ba4f-425d-98a6-9329d5158b93 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:17.279498 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 425/844] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:59:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:17.287219 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879db205-08f5-4c62-8f8f-ff6f4282b706 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:17.335460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:17.406706 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879db205-08f5-4c62-8f8f-ff6f4282b706 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:17.455760 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e6f13-4b08-475e-b669-b9e1c5040fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:17.456682 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e6f13-4b08-475e-b669-b9e1c5040fb6 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:17.457032 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e6f13-4b08-475e-b669-b9e1c5040fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:17.457311 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476e6f13-4b08-475e-b669-b9e1c5040fb6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:17.469356 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e6f13-4b08-475e-b669-b9e1c5040fb6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:17.470957 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476e6f13-4b08-475e-b669-b9e1c5040fb6 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-476e6f13-4b08-475e-b669-b9e1c5040fb6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:59:17.492711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:17.494098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:17.495209 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:59:17.495209 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:59:17.495209 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:17.495209 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:17.495209 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 420/845] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:17.501289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ad95a-ba4f-425d-98a6-9329d5158b93 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:17.628883 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68ad95a-ba4f-425d-98a6-9329d5158b93 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:17.665250 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b31442-89af-4b77-b6cc-6b85abde9f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:17.665946 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b31442-89af-4b77-b6cc-6b85abde9f4e None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:17.666230 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b31442-89af-4b77-b6cc-6b85abde9f4e None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:17.666598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b31442-89af-4b77-b6cc-6b85abde9f4e None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:17.667464 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b31442-89af-4b77-b6cc-6b85abde9f4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:17.667796 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b31442-89af-4b77-b6cc-6b85abde9f4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:17.669412 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b31442-89af-4b77-b6cc-6b85abde9f4e None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:17.683371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 426/846] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:59:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:17.689555 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e6f13-4b08-475e-b669-b9e1c5040fb6 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:17.802380 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:17.814952 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476e6f13-4b08-475e-b669-b9e1c5040fb6 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:17.860705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e3927-9af9-4980-a936-3f548f074675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:17.861586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e3927-9af9-4980-a936-3f548f074675 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:17.861870 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e3927-9af9-4980-a936-3f548f074675 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:17.862145 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232e3927-9af9-4980-a936-3f548f074675 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:17.870448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e3927-9af9-4980-a936-3f548f074675 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:17.871905 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-232e3927-9af9-4980-a936-3f548f074675 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-232e3927-9af9-4980-a936-3f548f074675 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:59:17.889797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:17.890936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:17.891939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:17.891939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:17.891939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:59:17.891939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:59:17.891939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:59:17.891939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:59:17.891939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:59:17.891939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:59:17.891939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 07:59:17.891939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:17.891939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 421/847] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:17.897915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b31442-89af-4b77-b6cc-6b85abde9f4e None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:17.955040 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:18.034022 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b31442-89af-4b77-b6cc-6b85abde9f4e None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:18.080224 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef0254-6156-4550-b4c5-7cc939fb1c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:18.081175 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef0254-6156-4550-b4c5-7cc939fb1c02 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:18.081605 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef0254-6156-4550-b4c5-7cc939fb1c02 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:18.081990 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ef0254-6156-4550-b4c5-7cc939fb1c02 None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:18.083149 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef0254-6156-4550-b4c5-7cc939fb1c02 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:18.083706 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef0254-6156-4550-b4c5-7cc939fb1c02 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:18.085867 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ef0254-6156-4550-b4c5-7cc939fb1c02 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:18.115411 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 427/848] 10.222.0.25 () {56 vars in 1143 bytes} [Wed May 25 07:59:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:18.116860 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e3927-9af9-4980-a936-3f548f074675 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:18.256881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-232e3927-9af9-4980-a936-3f548f074675 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:18.305221 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f4437-3fb9-444d-a048-456d20d3a610 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:18.306054 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f4437-3fb9-444d-a048-456d20d3a610 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:18.306480 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f4437-3fb9-444d-a048-456d20d3a610 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:18.306850 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f4437-3fb9-444d-a048-456d20d3a610 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:18.320290 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f4437-3fb9-444d-a048-456d20d3a610 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:18.321942 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f4437-3fb9-444d-a048-456d20d3a610 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-939f4437-3fb9-444d-a048-456d20d3a610 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:59:18.343052 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:18.344269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:18.345289 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:59:18.345289 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:59:18.345289 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:18.345289 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:18.345289 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 422/849] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:18.351634 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef0254-6156-4550-b4c5-7cc939fb1c02 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:18.501366 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ef0254-6156-4550-b4c5-7cc939fb1c02 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:18.504712 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:18.549710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583f59e-8fd0-4c08-8e55-6da19d1eca3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:18.550697 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583f59e-8fd0-4c08-8e55-6da19d1eca3d None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:18.551052 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583f59e-8fd0-4c08-8e55-6da19d1eca3d None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:18.551594 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b583f59e-8fd0-4c08-8e55-6da19d1eca3d None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:18.553173 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583f59e-8fd0-4c08-8e55-6da19d1eca3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:18.553647 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583f59e-8fd0-4c08-8e55-6da19d1eca3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:18.555746 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b583f59e-8fd0-4c08-8e55-6da19d1eca3d None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:18.573407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 428/850] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:59:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:59:18.580429 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f4437-3fb9-444d-a048-456d20d3a610 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:18.584954 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:18.723722 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f4437-3fb9-444d-a048-456d20d3a610 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:18.768985 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bf8f9-4f1a-4da2-a415-7fde3aec44ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:18.770344 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bf8f9-4f1a-4da2-a415-7fde3aec44ae None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:18.770628 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bf8f9-4f1a-4da2-a415-7fde3aec44ae None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:18.770899 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748bf8f9-4f1a-4da2-a415-7fde3aec44ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:18.778923 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bf8f9-4f1a-4da2-a415-7fde3aec44ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:18.781553 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748bf8f9-4f1a-4da2-a415-7fde3aec44ae None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-748bf8f9-4f1a-4da2-a415-7fde3aec44ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:59:18.798331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:18.801825 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:18.804310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:59:18.804310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:59:18.804310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:59:18.804310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:59:18.804310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:59:18.804310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:59:18.804310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:59:18.804310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:18.804310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 423/851] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:59:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:18.806122 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583f59e-8fd0-4c08-8e55-6da19d1eca3d None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:18.951049 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b583f59e-8fd0-4c08-8e55-6da19d1eca3d None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:18.990252 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d976848-5b6c-412c-a2c4-9fe631658905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:18.990996 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d976848-5b6c-412c-a2c4-9fe631658905 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:18.991282 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d976848-5b6c-412c-a2c4-9fe631658905 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:18.991638 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d976848-5b6c-412c-a2c4-9fe631658905 None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:18.992510 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d976848-5b6c-412c-a2c4-9fe631658905 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:18.992832 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d976848-5b6c-412c-a2c4-9fe631658905 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:18.994376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d976848-5b6c-412c-a2c4-9fe631658905 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:19.010613 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 429/852] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:59:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:19.019691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bf8f9-4f1a-4da2-a415-7fde3aec44ae None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:19.113883 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:19.164263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748bf8f9-4f1a-4da2-a415-7fde3aec44ae None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:19.211508 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2caf340-d7e0-4b61-bced-dfefe9034c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:19.212583 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caf340-d7e0-4b61-bced-dfefe9034c39 None admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:19.212963 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caf340-d7e0-4b61-bced-dfefe9034c39 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:19.213191 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2caf340-d7e0-4b61-bced-dfefe9034c39 None admin] PATH_INFO: `/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/852fb6ed2a764a7db2c2497980c2e06f/roles/032121f695584aebbac76f0f8ca183fa` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:19.230909 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caf340-d7e0-4b61-bced-dfefe9034c39 None admin] RBAC: Authorizing `identity:create_grant(project_id=b056475a8e394bb3bae06f030dee95ab, user_id=852fb6ed2a764a7db2c2497980c2e06f, role_id=032121f695584aebbac76f0f8ca183fa)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:19.232680 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2caf340-d7e0-4b61-bced-dfefe9034c39 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:19.250339 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 424/853] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:59:19 2022] PUT /identity/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/852fb6ed2a764a7db2c2497980c2e06f/roles/032121f695584aebbac76f0f8ca183fa => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:59:21.801672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda3a57-d950-4ff4-98e8-08b79647e0cf None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:21.802204 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda3a57-d950-4ff4-98e8-08b79647e0cf None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:21.802333 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdda3a57-d950-4ff4-98e8-08b79647e0cf None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:21.803728 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 430/854] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:59:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:59:21.809463 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845d324-4d0b-4c0c-be4c-37589dff9a0e None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:21.810032 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845d324-4d0b-4c0c-be4c-37589dff9a0e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:21.810032 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a845d324-4d0b-4c0c-be4c-37589dff9a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:21.827934 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-a845d324-4d0b-4c0c-be4c-37589dff9a0e None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:59:21.829228 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a845d324-4d0b-4c0c-be4c-37589dff9a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:59:21.915627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 425/855] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:59:21 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:59:21.942752 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda3a57-d950-4ff4-98e8-08b79647e0cf None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:21.970771 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:22.059873 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdda3a57-d950-4ff4-98e8-08b79647e0cf None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:22.101145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e6f4a-6e57-41aa-b62a-5ce3afdd0d6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:22.101940 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e6f4a-6e57-41aa-b62a-5ce3afdd0d6a None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:22.102231 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e6f4a-6e57-41aa-b62a-5ce3afdd0d6a None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:22.102510 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6e6f4a-6e57-41aa-b62a-5ce3afdd0d6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:22.115282 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6e6f4a-6e57-41aa-b62a-5ce3afdd0d6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-5c6e6f4a-6e57-41aa-b62a-5ce3afdd0d6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:59:22.123164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:22.124413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:22.125337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:22.125337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:22.125337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:22.125337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:22.125337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:59:22.125337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:59:22.125337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:59:22.125337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:59:22.125337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:59:22.125337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:59:22.125337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 25 07:59:22.125337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:22.125337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 431/856] 10.222.0.25 () {56 vars in 1102 bytes} [Wed May 25 07:59:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:22.132069 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845d324-4d0b-4c0c-be4c-37589dff9a0e None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:22.185474 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:22.262882 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a845d324-4d0b-4c0c-be4c-37589dff9a0e None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:22.302747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3978eb2-5ed2-4b70-a335-7353dc4f1bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:22.303828 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3978eb2-5ed2-4b70-a335-7353dc4f1bc7 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:22.304112 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3978eb2-5ed2-4b70-a335-7353dc4f1bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:22.304429 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3978eb2-5ed2-4b70-a335-7353dc4f1bc7 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:22.305307 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3978eb2-5ed2-4b70-a335-7353dc4f1bc7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:22.305512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3978eb2-5ed2-4b70-a335-7353dc4f1bc7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:22.306944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3978eb2-5ed2-4b70-a335-7353dc4f1bc7 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:22.316957 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 426/857] 10.222.0.25 () {56 vars in 1103 bytes} [Wed May 25 07:59:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:22.322635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e6f4a-6e57-41aa-b62a-5ce3afdd0d6a None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:22.414110 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:22.434561 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6e6f4a-6e57-41aa-b62a-5ce3afdd0d6a None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:22.478440 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28835b-48ed-4a21-8be4-443d450ba894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:22.479825 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28835b-48ed-4a21-8be4-443d450ba894 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:22.480369 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28835b-48ed-4a21-8be4-443d450ba894 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:22.480873 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28835b-48ed-4a21-8be4-443d450ba894 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:22.498773 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28835b-48ed-4a21-8be4-443d450ba894 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:22.501475 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28835b-48ed-4a21-8be4-443d450ba894 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-5e28835b-48ed-4a21-8be4-443d450ba894 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:59:22.532222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:22.533862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:22.535781 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:59:22.535781 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:59:22.535781 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:22.535781 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:22.535781 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 432/858] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:22.540048 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3978eb2-5ed2-4b70-a335-7353dc4f1bc7 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:22.674939 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3978eb2-5ed2-4b70-a335-7353dc4f1bc7 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:22.678950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:22.723086 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252f4dc-cf24-440c-acfb-9fc4a1889ddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:22.724490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252f4dc-cf24-440c-acfb-9fc4a1889ddd None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:22.724982 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252f4dc-cf24-440c-acfb-9fc4a1889ddd None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:22.725481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252f4dc-cf24-440c-acfb-9fc4a1889ddd None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:22.726300 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252f4dc-cf24-440c-acfb-9fc4a1889ddd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:22.726800 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252f4dc-cf24-440c-acfb-9fc4a1889ddd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:22.729721 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252f4dc-cf24-440c-acfb-9fc4a1889ddd None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:22.751635 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 427/859] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:59:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:59:22.758263 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28835b-48ed-4a21-8be4-443d450ba894 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:22.906211 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28835b-48ed-4a21-8be4-443d450ba894 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:22.947894 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376da7c-030b-447c-ad3c-42925fd8a85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:22.950096 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376da7c-030b-447c-ad3c-42925fd8a85b None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:22.950456 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376da7c-030b-447c-ad3c-42925fd8a85b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:22.950789 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6376da7c-030b-447c-ad3c-42925fd8a85b None admin] PATH_INFO: `/v3/users/placement` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:22.954549 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:22.960435 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376da7c-030b-447c-ad3c-42925fd8a85b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:22.962106 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6376da7c-030b-447c-ad3c-42925fd8a85b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-6376da7c-030b-447c-ad3c-42925fd8a85b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:59:22.985399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:22.986691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:22.992532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:22.992532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:22.992532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:59:22.992532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:59:22.992532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:59:22.992532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:59:22.992532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:59:22.992532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:59:22.992532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 07:59:22.992532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:22.992532 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 433/860] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:22.993483 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252f4dc-cf24-440c-acfb-9fc4a1889ddd None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:23.136056 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252f4dc-cf24-440c-acfb-9fc4a1889ddd None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:23.179122 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a65ca9-3a77-42e0-b2ac-2d5963cc2745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:23.179824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a65ca9-3a77-42e0-b2ac-2d5963cc2745 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:23.180112 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a65ca9-3a77-42e0-b2ac-2d5963cc2745 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:23.180429 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a65ca9-3a77-42e0-b2ac-2d5963cc2745 None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:23.181294 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a65ca9-3a77-42e0-b2ac-2d5963cc2745 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:23.181606 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a65ca9-3a77-42e0-b2ac-2d5963cc2745 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:23.183127 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a65ca9-3a77-42e0-b2ac-2d5963cc2745 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:23.209959 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 428/861] 10.222.0.25 () {56 vars in 1143 bytes} [Wed May 25 07:59:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:23.211023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376da7c-030b-447c-ad3c-42925fd8a85b None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:23.346870 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6376da7c-030b-447c-ad3c-42925fd8a85b None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:23.396025 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9bb39-eb45-4f09-9639-3917ea257729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:23.396025 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9bb39-eb45-4f09-9639-3917ea257729 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:23.396025 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9bb39-eb45-4f09-9639-3917ea257729 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:23.396025 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c9bb39-eb45-4f09-9639-3917ea257729 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:23.471802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:23.482674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9bb39-eb45-4f09-9639-3917ea257729 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:23.485316 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c9bb39-eb45-4f09-9639-3917ea257729 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:23.626031 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 434/862] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:59:23 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:59:23.631953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a65ca9-3a77-42e0-b2ac-2d5963cc2745 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:23.660478 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:23.760587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a65ca9-3a77-42e0-b2ac-2d5963cc2745 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:23.811227 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca2822-217c-420b-933c-2a52b5cdfaf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:23.812114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca2822-217c-420b-933c-2a52b5cdfaf7 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:23.812454 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca2822-217c-420b-933c-2a52b5cdfaf7 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:23.812736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dca2822-217c-420b-933c-2a52b5cdfaf7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:23.825156 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca2822-217c-420b-933c-2a52b5cdfaf7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:23.826665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dca2822-217c-420b-933c-2a52b5cdfaf7 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-1dca2822-217c-420b-933c-2a52b5cdfaf7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:59:23.848935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:23.850282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:23.851460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:59:23.851460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:59:23.851460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:23.851460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:23.855205 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 429/863] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:59:23.856394 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9bb39-eb45-4f09-9639-3917ea257729 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:23.971122 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:23.978334 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c9bb39-eb45-4f09-9639-3917ea257729 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:24.017596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b98fc-4e36-4f7b-a415-3b46de19d922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:24.018182 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b98fc-4e36-4f7b-a415-3b46de19d922 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:24.018471 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b98fc-4e36-4f7b-a415-3b46de19d922 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:24.018751 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370b98fc-4e36-4f7b-a415-3b46de19d922 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:24.020061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b98fc-4e36-4f7b-a415-3b46de19d922 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:24.020531 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b98fc-4e36-4f7b-a415-3b46de19d922 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:24.021932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370b98fc-4e36-4f7b-a415-3b46de19d922 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:24.035292 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 435/864] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:59:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:59:24.041572 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca2822-217c-420b-933c-2a52b5cdfaf7 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:24.143269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:24.204092 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dca2822-217c-420b-933c-2a52b5cdfaf7 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:24.265432 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaeb5b-5a4d-4586-85dd-ec931b0dd391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:24.266495 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaeb5b-5a4d-4586-85dd-ec931b0dd391 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:24.266827 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaeb5b-5a4d-4586-85dd-ec931b0dd391 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:24.267222 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45aaeb5b-5a4d-4586-85dd-ec931b0dd391 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:24.281262 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaeb5b-5a4d-4586-85dd-ec931b0dd391 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:24.283270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45aaeb5b-5a4d-4586-85dd-ec931b0dd391 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-45aaeb5b-5a4d-4586-85dd-ec931b0dd391 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:59:24.306195 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:24.307627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:24.309512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:59:24.309512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:59:24.309512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:59:24.309512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:59:24.309512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:59:24.309512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:59:24.309512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:59:24.309512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:24.309512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 430/865] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:59:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:24.314108 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b98fc-4e36-4f7b-a415-3b46de19d922 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:24.443755 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370b98fc-4e36-4f7b-a415-3b46de19d922 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:24.521263 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b7bc6c-66dd-4e22-99a7-d850f9cb9c0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:24.521945 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7bc6c-66dd-4e22-99a7-d850f9cb9c0d None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:24.522227 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7bc6c-66dd-4e22-99a7-d850f9cb9c0d None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:24.522502 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b7bc6c-66dd-4e22-99a7-d850f9cb9c0d None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:24.523298 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7bc6c-66dd-4e22-99a7-d850f9cb9c0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:24.523606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7bc6c-66dd-4e22-99a7-d850f9cb9c0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:24.525120 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b7bc6c-66dd-4e22-99a7-d850f9cb9c0d None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:24.540152 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 436/866] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:59:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:24.546397 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaeb5b-5a4d-4586-85dd-ec931b0dd391 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:24.657744 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45aaeb5b-5a4d-4586-85dd-ec931b0dd391 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:24.710823 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421983e-c66f-4ff1-a5e7-e71cbaf0a7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:24.711582 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421983e-c66f-4ff1-a5e7-e71cbaf0a7c2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:24.712083 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421983e-c66f-4ff1-a5e7-e71cbaf0a7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:24.712459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421983e-c66f-4ff1-a5e7-e71cbaf0a7c2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:24.713920 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421983e-c66f-4ff1-a5e7-e71cbaf0a7c2 None admin] RBAC: Adding query filter params (role.id=032121f695584aebbac76f0f8ca183fa, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=852fb6ed2a764a7db2c2497980c2e06f) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:24.714312 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421983e-c66f-4ff1-a5e7-e71cbaf0a7c2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:24.715959 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421983e-c66f-4ff1-a5e7-e71cbaf0a7c2 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:24.719090 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:24.726638 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 431/867] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:59:24 2022] GET /identity/v3/role_assignments?user.id=852fb6ed2a764a7db2c2497980c2e06f&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=032121f695584aebbac76f0f8ca183fa => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 07:59:27.525264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187a6d8-aa16-48c6-a038-302bdb728049 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:27.525875 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187a6d8-aa16-48c6-a038-302bdb728049 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:27.526126 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1187a6d8-aa16-48c6-a038-302bdb728049 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:27.529010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 437/868] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:59:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:59:27.537610 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ad99b-26dd-4cdf-92a4-51db70bf4836 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:27.538150 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ad99b-26dd-4cdf-92a4-51db70bf4836 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:27.538394 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ad99b-26dd-4cdf-92a4-51db70bf4836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:27.560542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-366ad99b-26dd-4cdf-92a4-51db70bf4836 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:59:27.562108 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-366ad99b-26dd-4cdf-92a4-51db70bf4836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:59:27.646046 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 432/869] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:59:27 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:59:27.671899 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187a6d8-aa16-48c6-a038-302bdb728049 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:27.693725 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:27.801661 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1187a6d8-aa16-48c6-a038-302bdb728049 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:27.842686 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b8005-5359-435c-9e94-bd201ddf45e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:27.843519 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b8005-5359-435c-9e94-bd201ddf45e3 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:27.843813 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b8005-5359-435c-9e94-bd201ddf45e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:27.844098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8b8005-5359-435c-9e94-bd201ddf45e3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:27.856913 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8b8005-5359-435c-9e94-bd201ddf45e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-6e8b8005-5359-435c-9e94-bd201ddf45e3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:59:27.869248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:27.870447 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:27.871285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:27.871285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:27.871285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:27.871285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:27.871285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:59:27.871285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:59:27.871285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:59:27.871285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:59:27.871285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:59:27.871285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:59:27.871285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:59:27.871285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:27.871285 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 438/870] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:59:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:59:27.877039 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ad99b-26dd-4cdf-92a4-51db70bf4836 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:27.994708 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ad99b-26dd-4cdf-92a4-51db70bf4836 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:28.028661 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:28.038115 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b16a8-3c32-4c33-82c0-36ed92576da2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:28.038790 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b16a8-3c32-4c33-82c0-36ed92576da2 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:28.039072 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b16a8-3c32-4c33-82c0-36ed92576da2 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:28.039345 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b16a8-3c32-4c33-82c0-36ed92576da2 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:28.040100 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b16a8-3c32-4c33-82c0-36ed92576da2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:28.040508 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b16a8-3c32-4c33-82c0-36ed92576da2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:28.042066 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b16a8-3c32-4c33-82c0-36ed92576da2 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:28.051970 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 433/871] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:59:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:28.057393 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b8005-5359-435c-9e94-bd201ddf45e3 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:28.146145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:28.173310 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8b8005-5359-435c-9e94-bd201ddf45e3 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:28.211977 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ea595-c525-4b5e-9586-30bd4803a1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:28.212887 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ea595-c525-4b5e-9586-30bd4803a1d7 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:28.213209 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ea595-c525-4b5e-9586-30bd4803a1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:28.213486 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ea595-c525-4b5e-9586-30bd4803a1d7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:28.224836 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ea595-c525-4b5e-9586-30bd4803a1d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:28.226407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ea595-c525-4b5e-9586-30bd4803a1d7 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-8a3ea595-c525-4b5e-9586-30bd4803a1d7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:59:28.244658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:28.245798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:28.246881 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:59:28.246881 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:59:28.246881 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:28.246881 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:28.250557 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 439/872] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:28.252256 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b16a8-3c32-4c33-82c0-36ed92576da2 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:28.374761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b16a8-3c32-4c33-82c0-36ed92576da2 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:28.414474 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432172-3e81-4c72-b429-97596e411c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:28.415136 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432172-3e81-4c72-b429-97596e411c84 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:28.415427 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432172-3e81-4c72-b429-97596e411c84 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:28.415710 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25432172-3e81-4c72-b429-97596e411c84 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:28.416465 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25432172-3e81-4c72-b429-97596e411c84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:28.416777 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25432172-3e81-4c72-b429-97596e411c84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:28.418162 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25432172-3e81-4c72-b429-97596e411c84 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:28.436484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 434/873] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:59:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:28.437748 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ea595-c525-4b5e-9586-30bd4803a1d7 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:28.548582 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ea595-c525-4b5e-9586-30bd4803a1d7 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:28.582555 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:28.593861 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3a732-d138-47c6-9bf6-730c9dfc6bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:28.594693 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3a732-d138-47c6-9bf6-730c9dfc6bf9 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:28.594981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3a732-d138-47c6-9bf6-730c9dfc6bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:28.595261 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d3a732-d138-47c6-9bf6-730c9dfc6bf9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:28.606405 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3a732-d138-47c6-9bf6-730c9dfc6bf9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:28.607988 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75d3a732-d138-47c6-9bf6-730c9dfc6bf9 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-75d3a732-d138-47c6-9bf6-730c9dfc6bf9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:59:28.623453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:28.624656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:28.625949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:28.625949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:28.625949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:59:28.625949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:59:28.625949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:59:28.625949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:59:28.625949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:59:28.625949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:59:28.625949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 07:59:28.625949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:28.625949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 440/874] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:28.632398 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432172-3e81-4c72-b429-97596e411c84 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:28.686883 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:28.746678 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25432172-3e81-4c72-b429-97596e411c84 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:28.795918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec04b3d-9255-441a-b596-00445d1ee8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:28.796873 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec04b3d-9255-441a-b596-00445d1ee8ab None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:28.797355 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec04b3d-9255-441a-b596-00445d1ee8ab None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:28.797648 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec04b3d-9255-441a-b596-00445d1ee8ab None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:28.798910 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec04b3d-9255-441a-b596-00445d1ee8ab None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:28.799410 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec04b3d-9255-441a-b596-00445d1ee8ab None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:28.802025 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec04b3d-9255-441a-b596-00445d1ee8ab None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:28.822789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 435/875] 10.222.0.25 () {56 vars in 1143 bytes} [Wed May 25 07:59:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:28.828514 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3a732-d138-47c6-9bf6-730c9dfc6bf9 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:28.949255 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d3a732-d138-47c6-9bf6-730c9dfc6bf9 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:28.983591 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95f5d1-9359-4a11-9dda-4837dd1a2fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:28.984283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95f5d1-9359-4a11-9dda-4837dd1a2fd6 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:28.984574 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95f5d1-9359-4a11-9dda-4837dd1a2fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:28.984848 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d95f5d1-9359-4a11-9dda-4837dd1a2fd6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:29.051182 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:29.066434 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95f5d1-9359-4a11-9dda-4837dd1a2fd6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:29.068611 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d95f5d1-9359-4a11-9dda-4837dd1a2fd6 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:29.191924 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 441/876] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:59:28 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:59:29.198493 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec04b3d-9255-441a-b596-00445d1ee8ab None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:29.312876 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec04b3d-9255-441a-b596-00445d1ee8ab None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:29.324272 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:29.352441 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2158b5-b9da-40a7-baa8-8bac8a9e3750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:29.353316 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2158b5-b9da-40a7-baa8-8bac8a9e3750 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:29.353593 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2158b5-b9da-40a7-baa8-8bac8a9e3750 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:29.353855 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2158b5-b9da-40a7-baa8-8bac8a9e3750 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:29.366121 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2158b5-b9da-40a7-baa8-8bac8a9e3750 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:29.367811 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2158b5-b9da-40a7-baa8-8bac8a9e3750 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-4e2158b5-b9da-40a7-baa8-8bac8a9e3750 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:59:29.387568 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:29.388953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:29.389890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:59:29.389890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:59:29.389890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:29.389890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:29.389890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 436/877] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:59:29.395618 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95f5d1-9359-4a11-9dda-4837dd1a2fd6 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:29.497207 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:29.511999 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d95f5d1-9359-4a11-9dda-4837dd1a2fd6 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:29.553771 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9001adb-0d45-42f0-ad56-541fdbf8e607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:29.554681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001adb-0d45-42f0-ad56-541fdbf8e607 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:29.554967 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001adb-0d45-42f0-ad56-541fdbf8e607 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:29.555427 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9001adb-0d45-42f0-ad56-541fdbf8e607 None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:29.556409 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9001adb-0d45-42f0-ad56-541fdbf8e607 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:29.556741 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9001adb-0d45-42f0-ad56-541fdbf8e607 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:29.558049 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9001adb-0d45-42f0-ad56-541fdbf8e607 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:29.571135 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 442/878] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:59:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:29.576904 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2158b5-b9da-40a7-baa8-8bac8a9e3750 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:29.697485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2158b5-b9da-40a7-baa8-8bac8a9e3750 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:29.734634 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74233864-fea7-4fbc-b9ea-e0ba3c3ac2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:29.735433 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74233864-fea7-4fbc-b9ea-e0ba3c3ac2fe None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:29.735714 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74233864-fea7-4fbc-b9ea-e0ba3c3ac2fe None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:29.735988 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74233864-fea7-4fbc-b9ea-e0ba3c3ac2fe None admin] PATH_INFO: `/v3/projects/service` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:29.743532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74233864-fea7-4fbc-b9ea-e0ba3c3ac2fe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:29.745030 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74233864-fea7-4fbc-b9ea-e0ba3c3ac2fe None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-74233864-fea7-4fbc-b9ea-e0ba3c3ac2fe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:59:29.759439 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:29.760621 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:29.761739 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:59:29.761739 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:59:29.761739 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:59:29.761739 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:59:29.761739 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:59:29.761739 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:59:29.761739 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:59:29.761739 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:29.764333 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 437/879] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:59:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:29.767214 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9001adb-0d45-42f0-ad56-541fdbf8e607 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:29.875505 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9001adb-0d45-42f0-ad56-541fdbf8e607 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:29.911548 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71872d02-2f49-47f0-b9c2-c5ffadebe0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:29.912281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872d02-2f49-47f0-b9c2-c5ffadebe0f4 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:29.912556 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872d02-2f49-47f0-b9c2-c5ffadebe0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:29.912841 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71872d02-2f49-47f0-b9c2-c5ffadebe0f4 None admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:29.913640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71872d02-2f49-47f0-b9c2-c5ffadebe0f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:29.913953 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71872d02-2f49-47f0-b9c2-c5ffadebe0f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:29.915432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71872d02-2f49-47f0-b9c2-c5ffadebe0f4 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:29.929299 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 443/880] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:59:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:29.935833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74233864-fea7-4fbc-b9ea-e0ba3c3ac2fe None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:29.960311 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:30.044578 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74233864-fea7-4fbc-b9ea-e0ba3c3ac2fe None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:30.080281 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df013a32-eae9-4613-b7da-a318d517560c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:30.080956 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df013a32-eae9-4613-b7da-a318d517560c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:30.081507 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df013a32-eae9-4613-b7da-a318d517560c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:30.081641 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df013a32-eae9-4613-b7da-a318d517560c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:30.082385 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df013a32-eae9-4613-b7da-a318d517560c None admin] RBAC: Adding query filter params (role.id=5c1382efdc2e4eebaf5f15a4cdae58e0, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=852fb6ed2a764a7db2c2497980c2e06f) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:30.082702 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df013a32-eae9-4613-b7da-a318d517560c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:30.084179 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df013a32-eae9-4613-b7da-a318d517560c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:30.090338 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 438/881] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:59:29 2022] GET /identity/v3/role_assignments?user.id=852fb6ed2a764a7db2c2497980c2e06f&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:32.404034 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27032a3f-d3f2-4617-980f-fc197aecbaa0 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:32.404643 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27032a3f-d3f2-4617-980f-fc197aecbaa0 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:32.404729 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27032a3f-d3f2-4617-980f-fc197aecbaa0 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:32.406051 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 444/882] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:59:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:59:32.411128 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66771424-9ec6-4fa5-bf1d-dc89091665a2 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:32.411547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66771424-9ec6-4fa5-bf1d-dc89091665a2 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:32.411692 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66771424-9ec6-4fa5-bf1d-dc89091665a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:32.428045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-66771424-9ec6-4fa5-bf1d-dc89091665a2 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:59:32.429249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-66771424-9ec6-4fa5-bf1d-dc89091665a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:59:32.498434 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 439/883] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:59:32 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:59:32.523907 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27032a3f-d3f2-4617-980f-fc197aecbaa0 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:32.536766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:32.630058 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27032a3f-d3f2-4617-980f-fc197aecbaa0 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:32.663725 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b49fe-dd59-43b8-bee0-2a74577a9fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:32.664480 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b49fe-dd59-43b8-bee0-2a74577a9fd6 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:32.664769 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b49fe-dd59-43b8-bee0-2a74577a9fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:32.665050 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9b49fe-dd59-43b8-bee0-2a74577a9fd6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:32.675010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9b49fe-dd59-43b8-bee0-2a74577a9fd6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-0c9b49fe-dd59-43b8-bee0-2a74577a9fd6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:59:32.683167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:32.684283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:32.685355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:32.685355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:32.685355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:32.685355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:32.685355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:59:32.685355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:59:32.685355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:59:32.685355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:59:32.685355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:59:32.685355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:59:32.685355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:59:32.685355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:32.685355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 445/884] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:59:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:32.690358 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66771424-9ec6-4fa5-bf1d-dc89091665a2 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:32.705702 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:32.788698 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66771424-9ec6-4fa5-bf1d-dc89091665a2 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:32.822201 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5568d6-227c-42cc-8571-5b5abd917379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:32.822860 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5568d6-227c-42cc-8571-5b5abd917379 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:32.823142 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5568d6-227c-42cc-8571-5b5abd917379 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:32.823416 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5568d6-227c-42cc-8571-5b5abd917379 None admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:32.824180 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5568d6-227c-42cc-8571-5b5abd917379 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:32.824490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5568d6-227c-42cc-8571-5b5abd917379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:32.825865 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5568d6-227c-42cc-8571-5b5abd917379 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:32.834089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 440/885] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:59:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:32.841187 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b49fe-dd59-43b8-bee0-2a74577a9fd6 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:32.910181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:32.944164 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9b49fe-dd59-43b8-bee0-2a74577a9fd6 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:32.977233 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef2bc9-de8b-496d-9ca5-1556ea4eebca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:32.978021 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef2bc9-de8b-496d-9ca5-1556ea4eebca None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:32.978307 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef2bc9-de8b-496d-9ca5-1556ea4eebca None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:32.978584 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ef2bc9-de8b-496d-9ca5-1556ea4eebca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:32.989196 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef2bc9-de8b-496d-9ca5-1556ea4eebca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:32.990651 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ef2bc9-de8b-496d-9ca5-1556ea4eebca None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-87ef2bc9-de8b-496d-9ca5-1556ea4eebca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:59:33.007743 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:33.008895 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:33.009772 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:59:33.009772 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:59:33.009772 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:33.009772 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:33.009772 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 446/886] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:33.015095 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5568d6-227c-42cc-8571-5b5abd917379 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:33.093860 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:33.123414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5568d6-227c-42cc-8571-5b5abd917379 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:33.159526 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66447196-46df-468f-bab3-c2eb9b831247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:33.160220 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447196-46df-468f-bab3-c2eb9b831247 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:33.160510 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447196-46df-468f-bab3-c2eb9b831247 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:33.160791 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66447196-46df-468f-bab3-c2eb9b831247 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:33.161513 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66447196-46df-468f-bab3-c2eb9b831247 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:33.161823 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66447196-46df-468f-bab3-c2eb9b831247 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:33.163211 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66447196-46df-468f-bab3-c2eb9b831247 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:33.174814 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 441/887] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:33.180708 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef2bc9-de8b-496d-9ca5-1556ea4eebca None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:33.278382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ef2bc9-de8b-496d-9ca5-1556ea4eebca None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:33.297893 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:33.312683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ae311-a284-4bb0-bd45-b0bc76f62b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:33.313482 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ae311-a284-4bb0-bd45-b0bc76f62b56 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:33.313765 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ae311-a284-4bb0-bd45-b0bc76f62b56 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:33.314038 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635ae311-a284-4bb0-bd45-b0bc76f62b56 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:33.321998 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ae311-a284-4bb0-bd45-b0bc76f62b56 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:33.323426 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635ae311-a284-4bb0-bd45-b0bc76f62b56 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-635ae311-a284-4bb0-bd45-b0bc76f62b56 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:59:33.337783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:33.338904 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:33.340046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:33.340046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:33.340046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:59:33.340046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:59:33.340046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:59:33.340046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:59:33.340046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:59:33.340046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:59:33.340046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 07:59:33.340046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:33.340046 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 447/888] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:33.344796 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66447196-46df-468f-bab3-c2eb9b831247 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:33.442493 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66447196-46df-468f-bab3-c2eb9b831247 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:33.477325 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066ab63-ca20-4ad8-8003-d32bc6df162d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:33.477998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066ab63-ca20-4ad8-8003-d32bc6df162d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:33.478284 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066ab63-ca20-4ad8-8003-d32bc6df162d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:33.478558 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1066ab63-ca20-4ad8-8003-d32bc6df162d None admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:33.479390 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066ab63-ca20-4ad8-8003-d32bc6df162d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:33.479696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066ab63-ca20-4ad8-8003-d32bc6df162d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:33.481164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1066ab63-ca20-4ad8-8003-d32bc6df162d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:33.483824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:33.502363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 442/889] 10.222.0.25 () {56 vars in 1143 bytes} [Wed May 25 07:59:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:33.508289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ae311-a284-4bb0-bd45-b0bc76f62b56 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:33.609100 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635ae311-a284-4bb0-bd45-b0bc76f62b56 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:33.642178 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0b9ec-b8ad-4edf-a5a6-b118a5b75ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:33.642965 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0b9ec-b8ad-4edf-a5a6-b118a5b75ede None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:33.643254 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0b9ec-b8ad-4edf-a5a6-b118a5b75ede None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:33.643536 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0b9ec-b8ad-4edf-a5a6-b118a5b75ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:33.654412 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0b9ec-b8ad-4edf-a5a6-b118a5b75ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:33.655863 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f0b9ec-b8ad-4edf-a5a6-b118a5b75ede None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-25f0b9ec-b8ad-4edf-a5a6-b118a5b75ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:59:33.672477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:33.673527 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:33.674518 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:59:33.674518 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:59:33.674518 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:33.674518 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:33.674518 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 448/890] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:33.679468 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066ab63-ca20-4ad8-8003-d32bc6df162d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:33.778258 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1066ab63-ca20-4ad8-8003-d32bc6df162d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:33.811615 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859f1c3-7821-4721-8925-f72a25871cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:33.812316 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859f1c3-7821-4721-8925-f72a25871cfc None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:33.812607 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859f1c3-7821-4721-8925-f72a25871cfc None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:33.812889 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3859f1c3-7821-4721-8925-f72a25871cfc None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:33.813609 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859f1c3-7821-4721-8925-f72a25871cfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:33.813919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859f1c3-7821-4721-8925-f72a25871cfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:33.815289 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3859f1c3-7821-4721-8925-f72a25871cfc None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:33.827138 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 443/891] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:59:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:33.833382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0b9ec-b8ad-4edf-a5a6-b118a5b75ede None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:33.865511 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:33.940035 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0b9ec-b8ad-4edf-a5a6-b118a5b75ede None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:33.973982 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030b315-2745-45dd-8cf9-5653f188900b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:33.974774 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030b315-2745-45dd-8cf9-5653f188900b None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:33.975062 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030b315-2745-45dd-8cf9-5653f188900b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:33.975342 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5030b315-2745-45dd-8cf9-5653f188900b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:33.981933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030b315-2745-45dd-8cf9-5653f188900b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:33.983368 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5030b315-2745-45dd-8cf9-5653f188900b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-5030b315-2745-45dd-8cf9-5653f188900b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:59:33.997854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:33.998896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:34.000002 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:59:34.000002 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:59:34.000002 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:59:34.000002 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:59:34.000002 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:59:34.000002 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:59:34.000002 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:59:34.000002 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:34.000002 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 449/892] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:59:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:34.005380 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859f1c3-7821-4721-8925-f72a25871cfc None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:34.060409 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:34.108838 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3859f1c3-7821-4721-8925-f72a25871cfc None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:34.145423 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f55946-99b7-4111-9a66-11a863dba74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:34.145981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f55946-99b7-4111-9a66-11a863dba74f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:34.146264 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f55946-99b7-4111-9a66-11a863dba74f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:34.146538 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f55946-99b7-4111-9a66-11a863dba74f None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:34.147324 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f55946-99b7-4111-9a66-11a863dba74f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:34.147632 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f55946-99b7-4111-9a66-11a863dba74f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:34.149106 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f55946-99b7-4111-9a66-11a863dba74f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:34.162414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 444/893] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:59:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:34.168607 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030b315-2745-45dd-8cf9-5653f188900b None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:34.266670 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:34.275756 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5030b315-2745-45dd-8cf9-5653f188900b None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:34.310549 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a6be60-5f92-44ce-9af7-970a9d6e57f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:34.311445 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6be60-5f92-44ce-9af7-970a9d6e57f3 None admin] REQUEST_METHOD: `PUT` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:34.311730 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6be60-5f92-44ce-9af7-970a9d6e57f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:34.312010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a6be60-5f92-44ce-9af7-970a9d6e57f3 None admin] PATH_INFO: `/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/852fb6ed2a764a7db2c2497980c2e06f/roles/5c1382efdc2e4eebaf5f15a4cdae58e0` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:34.314024 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6be60-5f92-44ce-9af7-970a9d6e57f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b056475a8e394bb3bae06f030dee95ab, user_id=852fb6ed2a764a7db2c2497980c2e06f, role_id=5c1382efdc2e4eebaf5f15a4cdae58e0)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:34.315499 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a6be60-5f92-44ce-9af7-970a9d6e57f3 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:34.329334 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 450/894] 10.222.0.25 () {58 vars in 1439 bytes} [Wed May 25 07:59:34 2022] PUT /identity/v3/projects/b056475a8e394bb3bae06f030dee95ab/users/852fb6ed2a764a7db2c2497980c2e06f/roles/5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 07:59:36.616399 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5106bc-a24b-4343-830d-c62d21e5e4d5 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:36.616982 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5106bc-a24b-4343-830d-c62d21e5e4d5 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:36.616982 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5106bc-a24b-4343-830d-c62d21e5e4d5 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:36.618330 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 445/895] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:59:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:59:36.624432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f4b0e-d790-4dc0-81bd-e7092fe4eef1 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:36.624961 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f4b0e-d790-4dc0-81bd-e7092fe4eef1 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:36.625086 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f4b0e-d790-4dc0-81bd-e7092fe4eef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:36.643056 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-875f4b0e-d790-4dc0-81bd-e7092fe4eef1 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:59:36.644906 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-875f4b0e-d790-4dc0-81bd-e7092fe4eef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:59:36.710224 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 451/896] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:59:36 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:59:36.735571 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5106bc-a24b-4343-830d-c62d21e5e4d5 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:36.837382 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5106bc-a24b-4343-830d-c62d21e5e4d5 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:36.851206 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:36.871481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec0def-740d-4a70-9f9a-70aa7aa88bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:36.872240 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0def-740d-4a70-9f9a-70aa7aa88bd1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:36.872530 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0def-740d-4a70-9f9a-70aa7aa88bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:36.872808 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ec0def-740d-4a70-9f9a-70aa7aa88bd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:36.885742 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ec0def-740d-4a70-9f9a-70aa7aa88bd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-37ec0def-740d-4a70-9f9a-70aa7aa88bd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(role_id) May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 25 07:59:36.893695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:36.895405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:36.896365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:36.896365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:36.896365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:36.896365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:36.896365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 25 07:59:36.896365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 25 07:59:36.896365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 25 07:59:36.896365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 25 07:59:36.896365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 25 07:59:36.896365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 25 07:59:36.896365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 25 07:59:36.896365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:36.896365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 446/897] 10.222.0.25 () {56 vars in 1096 bytes} [Wed May 25 07:59:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:36.901871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f4b0e-d790-4dc0-81bd-e7092fe4eef1 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:36.981494 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:37.000918 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f4b0e-d790-4dc0-81bd-e7092fe4eef1 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:37.033824 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4e7e3-e152-413e-abe5-5c3bf1105658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:37.034482 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4e7e3-e152-413e-abe5-5c3bf1105658 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:37.034763 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4e7e3-e152-413e-abe5-5c3bf1105658 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:37.035037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4e7e3-e152-413e-abe5-5c3bf1105658 None admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:37.035776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4e7e3-e152-413e-abe5-5c3bf1105658 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:37.036078 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4e7e3-e152-413e-abe5-5c3bf1105658 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:37.037492 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c4e7e3-e152-413e-abe5-5c3bf1105658 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:37.045215 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 452/898] 10.222.0.25 () {56 vars in 1099 bytes} [Wed May 25 07:59:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:37.051547 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec0def-740d-4a70-9f9a-70aa7aa88bd1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:37.150704 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ec0def-740d-4a70-9f9a-70aa7aa88bd1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:37.183378 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b6a4d-2af5-4d7d-b2c9-71744475dcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:37.184188 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b6a4d-2af5-4d7d-b2c9-71744475dcbf None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:37.184471 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b6a4d-2af5-4d7d-b2c9-71744475dcbf None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:37.184743 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b6a4d-2af5-4d7d-b2c9-71744475dcbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:37.195075 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b6a4d-2af5-4d7d-b2c9-71744475dcbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:37.196554 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b6a4d-2af5-4d7d-b2c9-71744475dcbf None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-bd2b6a4d-2af5-4d7d-b2c9-71744475dcbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:59:37.213458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:37.214552 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:37.218963 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:59:37.218963 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:59:37.218963 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:37.218963 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:37.218963 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 447/899] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 25 07:59:37.220631 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4e7e3-e152-413e-abe5-5c3bf1105658 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:37.318404 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c4e7e3-e152-413e-abe5-5c3bf1105658 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:37.360850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164ce78-3dc9-4098-a475-f17b6703e00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:37.361536 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ce78-3dc9-4098-a475-f17b6703e00d None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:37.361818 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ce78-3dc9-4098-a475-f17b6703e00d None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:37.362092 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164ce78-3dc9-4098-a475-f17b6703e00d None admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:37.362833 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164ce78-3dc9-4098-a475-f17b6703e00d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:37.363140 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164ce78-3dc9-4098-a475-f17b6703e00d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:37.364599 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164ce78-3dc9-4098-a475-f17b6703e00d None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:37.377753 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 453/900] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:59:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:37.384092 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b6a4d-2af5-4d7d-b2c9-71744475dcbf None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:37.414014 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:37.483874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b6a4d-2af5-4d7d-b2c9-71744475dcbf None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:37.524647 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ef121-1e2d-4ca4-bef6-6ba025ce46b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:37.525529 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ef121-1e2d-4ca4-bef6-6ba025ce46b1 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:37.525817 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ef121-1e2d-4ca4-bef6-6ba025ce46b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:37.526099 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401ef121-1e2d-4ca4-bef6-6ba025ce46b1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:37.535257 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ef121-1e2d-4ca4-bef6-6ba025ce46b1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:37.536946 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401ef121-1e2d-4ca4-bef6-6ba025ce46b1 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-401ef121-1e2d-4ca4-bef6-6ba025ce46b1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_user(user_id) May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 25 07:59:37.554751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:37.556114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:37.557151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:37.557151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:37.557151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 25 07:59:37.557151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 25 07:59:37.557151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 25 07:59:37.557151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 25 07:59:37.557151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 25 07:59:37.557151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 25 07:59:37.557151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 25 07:59:37.557151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:37.557151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 448/901] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:37.562819 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164ce78-3dc9-4098-a475-f17b6703e00d None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:37.567505 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:37.672712 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164ce78-3dc9-4098-a475-f17b6703e00d None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:37.709432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54bf00-2ec3-4937-ba0f-e2f228f1cb21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:37.710114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54bf00-2ec3-4937-ba0f-e2f228f1cb21 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:37.710403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54bf00-2ec3-4937-ba0f-e2f228f1cb21 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:37.710687 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a54bf00-2ec3-4937-ba0f-e2f228f1cb21 None admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:37.711548 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54bf00-2ec3-4937-ba0f-e2f228f1cb21 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:37.711865 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54bf00-2ec3-4937-ba0f-e2f228f1cb21 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:37.713401 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a54bf00-2ec3-4937-ba0f-e2f228f1cb21 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:37.732717 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 454/902] 10.222.0.25 () {56 vars in 1143 bytes} [Wed May 25 07:59:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:37.739212 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ef121-1e2d-4ca4-bef6-6ba025ce46b1 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:37.828321 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:37.844031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401ef121-1e2d-4ca4-bef6-6ba025ce46b1 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:37.878324 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0554-7576-4690-907d-d6832995910f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:37.879169 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0554-7576-4690-907d-d6832995910f None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:37.879454 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0554-7576-4690-907d-d6832995910f None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:37.879730 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e0554-7576-4690-907d-d6832995910f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:37.946373 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e0554-7576-4690-907d-d6832995910f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:37.947745 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9e0554-7576-4690-907d-d6832995910f None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:38.030730 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:38.046452 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 449/903] 10.222.0.25 () {58 vars in 1282 bytes} [Wed May 25 07:59:37 2022] GET /identity/v3/auth/tokens => generated 1859 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 25 07:59:38.052934 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54bf00-2ec3-4937-ba0f-e2f228f1cb21 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:38.113330 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:38.150678 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a54bf00-2ec3-4937-ba0f-e2f228f1cb21 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:38.184363 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6193d3-9415-464a-9428-264bab30a6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:38.185159 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6193d3-9415-464a-9428-264bab30a6e6 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:38.185444 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6193d3-9415-464a-9428-264bab30a6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:38.185724 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6193d3-9415-464a-9428-264bab30a6e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:38.195407 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6193d3-9415-464a-9428-264bab30a6e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:38.196968 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6193d3-9415-464a-9428-264bab30a6e6 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-bf6193d3-9415-464a-9428-264bab30a6e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 25 07:59:38.213775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:38.214854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:38.216023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 25 07:59:38.216023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 25 07:59:38.216023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 25 07:59:38.216023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:38.216023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 455/904] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 07:59:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:38.220844 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0554-7576-4690-907d-d6832995910f None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:38.318684 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e0554-7576-4690-907d-d6832995910f None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:38.353516 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace31ed7-eab4-4c4b-8ec2-a412f5c5f644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:38.354171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace31ed7-eab4-4c4b-8ec2-a412f5c5f644 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:38.354450 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace31ed7-eab4-4c4b-8ec2-a412f5c5f644 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:38.354721 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace31ed7-eab4-4c4b-8ec2-a412f5c5f644 None admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:38.355435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace31ed7-eab4-4c4b-8ec2-a412f5c5f644 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:38.355738 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace31ed7-eab4-4c4b-8ec2-a412f5c5f644 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:38.357225 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace31ed7-eab4-4c4b-8ec2-a412f5c5f644 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:38.369261 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 450/905] 10.222.0.25 () {56 vars in 1109 bytes} [Wed May 25 07:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:38.374910 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6193d3-9415-464a-9428-264bab30a6e6 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:38.478247 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6193d3-9415-464a-9428-264bab30a6e6 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:38.494203 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:38.518165 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747ba98-1ebb-49b0-8d61-c97d999e6251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:38.519526 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747ba98-1ebb-49b0-8d61-c97d999e6251 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:38.519817 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747ba98-1ebb-49b0-8d61-c97d999e6251 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:38.520098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e747ba98-1ebb-49b0-8d61-c97d999e6251 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:38.527049 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747ba98-1ebb-49b0-8d61-c97d999e6251 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:38.528533 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e747ba98-1ebb-49b0-8d61-c97d999e6251 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application [None req-e747ba98-1ebb-49b0-8d61-c97d999e6251 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(project_id) May 25 07:59:38.542666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application with Lock( May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:38.543734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:38.544705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 25 07:59:38.544705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 25 07:59:38.544705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 25 07:59:38.544705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 25 07:59:38.544705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 25 07:59:38.544705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 25 07:59:38.544705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 25 07:59:38.544705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: ERROR keystone.server.flask.application May 25 07:59:38.544705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 456/906] 10.222.0.25 () {56 vars in 1111 bytes} [Wed May 25 07:59:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:38.549762 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace31ed7-eab4-4c4b-8ec2-a412f5c5f644 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:38.596389 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:38.649582 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace31ed7-eab4-4c4b-8ec2-a412f5c5f644 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:38.682660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b2c6b3-6fe2-4e45-8ec8-9136709fab07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:38.683316 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2c6b3-6fe2-4e45-8ec8-9136709fab07 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:38.683604 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2c6b3-6fe2-4e45-8ec8-9136709fab07 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:38.683885 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b2c6b3-6fe2-4e45-8ec8-9136709fab07 None admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:38.684701 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2c6b3-6fe2-4e45-8ec8-9136709fab07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:38.685016 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2c6b3-6fe2-4e45-8ec8-9136709fab07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:38.686460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b2c6b3-6fe2-4e45-8ec8-9136709fab07 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:38.698840 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 451/907] 10.222.0.25 () {56 vars in 1148 bytes} [Wed May 25 07:59:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:38.704918 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747ba98-1ebb-49b0-8d61-c97d999e6251 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:38.804679 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e747ba98-1ebb-49b0-8d61-c97d999e6251 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:38.838640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebb986-4282-4ba1-a936-c7728ebd7b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:38.839289 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebb986-4282-4ba1-a936-c7728ebd7b5b None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:38.839576 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebb986-4282-4ba1-a936-c7728ebd7b5b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:38.839857 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebb986-4282-4ba1-a936-c7728ebd7b5b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:38.840711 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebb986-4282-4ba1-a936-c7728ebd7b5b None admin] RBAC: Adding query filter params (role.id=5c1382efdc2e4eebaf5f15a4cdae58e0, scope.project.id=b056475a8e394bb3bae06f030dee95ab, user.id=852fb6ed2a764a7db2c2497980c2e06f) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:38.841028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebb986-4282-4ba1-a936-c7728ebd7b5b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:38.842476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebb986-4282-4ba1-a936-c7728ebd7b5b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:38.848886 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 457/908] 10.222.0.25 () {56 vars in 1374 bytes} [Wed May 25 07:59:38 2022] GET /identity/v3/role_assignments?user.id=852fb6ed2a764a7db2c2497980c2e06f&scope.project.id=b056475a8e394bb3bae06f030dee95ab&role.id=5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:41.130976 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfbe39-c4e7-4ce9-b017-0af655ecb625 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:41.131565 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfbe39-c4e7-4ce9-b017-0af655ecb625 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:41.131565 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfbe39-c4e7-4ce9-b017-0af655ecb625 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:41.132866 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 452/909] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:59:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:59:41.138798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bba413-5515-4e0f-a585-a9a597165401 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:41.139300 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bba413-5515-4e0f-a585-a9a597165401 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:41.139399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bba413-5515-4e0f-a585-a9a597165401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:41.156858 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-b7bba413-5515-4e0f-a585-a9a597165401 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:59:41.158061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-b7bba413-5515-4e0f-a585-a9a597165401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:59:41.188101 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:41.231387 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 458/910] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:59:41 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:59:41.255442 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfbe39-c4e7-4ce9-b017-0af655ecb625 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:41.359581 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfbe39-c4e7-4ce9-b017-0af655ecb625 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:41.367339 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:41.398617 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d08e93-f927-45f9-aaac-1f62c3b22a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:41.399332 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d08e93-f927-45f9-aaac-1f62c3b22a3d None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:41.399616 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d08e93-f927-45f9-aaac-1f62c3b22a3d None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:41.399892 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d08e93-f927-45f9-aaac-1f62c3b22a3d None admin] PATH_INFO: `/v3/services/placement` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:41.400579 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d08e93-f927-45f9-aaac-1f62c3b22a3d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:41.401968 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d08e93-f927-45f9-aaac-1f62c3b22a3d None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-b6d08e93-f927-45f9-aaac-1f62c3b22a3d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:41.414881 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:41.416255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:41.417503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 453/911] 10.222.0.25 () {56 vars in 1117 bytes} [Wed May 25 07:59:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:41.423509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bba413-5515-4e0f-a585-a9a597165401 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:41.527525 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bba413-5515-4e0f-a585-a9a597165401 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:41.567123 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9313a288-6e7b-4210-aacd-c8b8af907aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:41.567924 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313a288-6e7b-4210-aacd-c8b8af907aaf None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:41.568247 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313a288-6e7b-4210-aacd-c8b8af907aaf None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:41.568563 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9313a288-6e7b-4210-aacd-c8b8af907aaf None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:41.569283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313a288-6e7b-4210-aacd-c8b8af907aaf None admin] RBAC: Adding query filter params (name=placement) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:41.569599 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313a288-6e7b-4210-aacd-c8b8af907aaf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:41.570971 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9313a288-6e7b-4210-aacd-c8b8af907aaf None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:41.575957 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 459/912] 10.222.0.25 () {56 vars in 1116 bytes} [Wed May 25 07:59:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:41.581787 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d08e93-f927-45f9-aaac-1f62c3b22a3d None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:41.679739 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d08e93-f927-45f9-aaac-1f62c3b22a3d None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:41.713490 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f70369-730c-4aa0-9ce1-a92fbff0459c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:41.714143 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f70369-730c-4aa0-9ce1-a92fbff0459c None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:41.714431 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f70369-730c-4aa0-9ce1-a92fbff0459c None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:41.714712 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f70369-730c-4aa0-9ce1-a92fbff0459c None admin] PATH_INFO: `/v3/services` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:41.715415 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f70369-730c-4aa0-9ce1-a92fbff0459c None admin] RBAC: Adding query filter params (type=placement) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:41.715725 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f70369-730c-4aa0-9ce1-a92fbff0459c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:41.717208 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f70369-730c-4aa0-9ce1-a92fbff0459c None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:41.721660 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 454/913] 10.222.0.25 () {56 vars in 1116 bytes} [Wed May 25 07:59:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:43.974751 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ff265-c5ac-4d95-8a4e-8624e2631614 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:43.975293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ff265-c5ac-4d95-8a4e-8624e2631614 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:43.975293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ff265-c5ac-4d95-8a4e-8624e2631614 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:43.976710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 460/914] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:59:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:59:43.981949 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a911446-12d5-4cf6-b381-aaa9b281fea3 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:43.982379 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a911446-12d5-4cf6-b381-aaa9b281fea3 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:43.982556 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a911446-12d5-4cf6-b381-aaa9b281fea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:43.999031 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-4a911446-12d5-4cf6-b381-aaa9b281fea3 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:59:44.000250 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-4a911446-12d5-4cf6-b381-aaa9b281fea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:59:44.026608 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:44.066023 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 455/915] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:59:43 2022] POST /identity/v3/auth/tokens => generated 1859 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 25 07:59:44.090455 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ff265-c5ac-4d95-8a4e-8624e2631614 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:44.121142 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:44.192659 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ff265-c5ac-4d95-8a4e-8624e2631614 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:44.230250 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20db231-ceb4-49e7-8466-c1d16cf7f285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:44.230937 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20db231-ceb4-49e7-8466-c1d16cf7f285 None admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:44.231221 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20db231-ceb4-49e7-8466-c1d16cf7f285 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:44.231496 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20db231-ceb4-49e7-8466-c1d16cf7f285 None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:44.232283 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20db231-ceb4-49e7-8466-c1d16cf7f285 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:44.233691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20db231-ceb4-49e7-8466-c1d16cf7f285 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:44.248041 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 461/916] 10.222.0.25 () {60 vars in 1141 bytes} [Wed May 25 07:59:44 2022] POST /identity/v3/services => generated 246 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:59:46.529806 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b04a02-2d9a-4f9d-b3bb-0b83eb98dcda None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:46.530365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b04a02-2d9a-4f9d-b3bb-0b83eb98dcda None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:46.530365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b04a02-2d9a-4f9d-b3bb-0b83eb98dcda None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:46.531722 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 456/917] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:59:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:59:46.537585 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad31b8-776d-4fa1-9f86-25fdd5e2338b None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:46.538037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad31b8-776d-4fa1-9f86-25fdd5e2338b None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:46.538131 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bad31b8-776d-4fa1-9f86-25fdd5e2338b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:46.555265 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-5bad31b8-776d-4fa1-9f86-25fdd5e2338b None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:59:46.556510 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-5bad31b8-776d-4fa1-9f86-25fdd5e2338b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:59:46.629376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 462/918] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:59:46 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:59:46.652946 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b04a02-2d9a-4f9d-b3bb-0b83eb98dcda None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:46.753235 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b04a02-2d9a-4f9d-b3bb-0b83eb98dcda None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:46.789637 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e377424-1ffb-4cf6-ba1a-beae591aabb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:46.790352 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e377424-1ffb-4cf6-ba1a-beae591aabb5 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:46.790634 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e377424-1ffb-4cf6-ba1a-beae591aabb5 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:46.790913 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e377424-1ffb-4cf6-ba1a-beae591aabb5 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:46.791560 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e377424-1ffb-4cf6-ba1a-beae591aabb5 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:46.792984 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e377424-1ffb-4cf6-ba1a-beae591aabb5 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-7e377424-1ffb-4cf6-ba1a-beae591aabb5 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:46.804629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:46.805772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:46.806627 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 457/919] 10.222.0.25 () {56 vars in 1117 bytes} [Wed May 25 07:59:46 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:46.813156 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad31b8-776d-4fa1-9f86-25fdd5e2338b None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:46.832385 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:46.913651 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bad31b8-776d-4fa1-9f86-25fdd5e2338b None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:46.946509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ab6a6-c511-4f84-958d-2b66a8c0ce10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:46.947227 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ab6a6-c511-4f84-958d-2b66a8c0ce10 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:46.947518 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ab6a6-c511-4f84-958d-2b66a8c0ce10 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:46.947791 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ab6a6-c511-4f84-958d-2b66a8c0ce10 None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:46.948579 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ab6a6-c511-4f84-958d-2b66a8c0ce10 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:46.948935 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ab6a6-c511-4f84-958d-2b66a8c0ce10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:46.950311 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20ab6a6-c511-4f84-958d-2b66a8c0ce10 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:46.957666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 463/920] 10.222.0.25 () {56 vars in 1116 bytes} [Wed May 25 07:59:46 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:46.963620 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e377424-1ffb-4cf6-ba1a-beae591aabb5 None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:46.993352 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:47.067432 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e377424-1ffb-4cf6-ba1a-beae591aabb5 None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:47.100834 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954f3bb9-8a78-4226-9edc-6793ed74ed74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:47.101491 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f3bb9-8a78-4226-9edc-6793ed74ed74 None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:47.101777 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f3bb9-8a78-4226-9edc-6793ed74ed74 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:47.102056 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954f3bb9-8a78-4226-9edc-6793ed74ed74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:47.102845 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f3bb9-8a78-4226-9edc-6793ed74ed74 None admin] RBAC: Adding query filter params (interface=public, service_id=52811e53bdfd4228abf43d28b85488c2, region_id=RegionOne) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:47.103159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f3bb9-8a78-4226-9edc-6793ed74ed74 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:47.104563 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954f3bb9-8a78-4226-9edc-6793ed74ed74 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:47.109560 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 458/921] 10.222.0.25 () {56 vars in 1251 bytes} [Wed May 25 07:59:46 2022] GET /identity/v3/endpoints?service_id=52811e53bdfd4228abf43d28b85488c2&interface=public®ion_id=RegionOne => generated 194 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:47.115633 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ab6a6-c511-4f84-958d-2b66a8c0ce10 None admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:47.195946 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:47.214798 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ab6a6-c511-4f84-958d-2b66a8c0ce10 None admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:47.247356 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf0cfc1-d3ae-4059-8037-38399af368f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:47.248016 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0cfc1-d3ae-4059-8037-38399af368f3 None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:47.248335 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0cfc1-d3ae-4059-8037-38399af368f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:47.248615 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf0cfc1-d3ae-4059-8037-38399af368f3 None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:47.249300 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0cfc1-d3ae-4059-8037-38399af368f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:47.250666 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf0cfc1-d3ae-4059-8037-38399af368f3 None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:47.257777 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 464/922] 10.222.0.25 () {56 vars in 1087 bytes} [Wed May 25 07:59:47 2022] GET /identity/v3/services => generated 1962 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 07:59:49.545722 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821f8b0-d5d9-4f91-a310-8db9af9c5f29 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:49.546294 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821f8b0-d5d9-4f91-a310-8db9af9c5f29 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:49.546294 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2821f8b0-d5d9-4f91-a310-8db9af9c5f29 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:49.547649 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 459/923] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 07:59:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 07:59:49.553441 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d039-130e-489d-9beb-d94851192f66 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:49.553995 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d039-130e-489d-9beb-d94851192f66 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:49.553995 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3531d039-130e-489d-9beb-d94851192f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:49.571695 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-3531d039-130e-489d-9beb-d94851192f66 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 07:59:49.572955 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-3531d039-130e-489d-9beb-d94851192f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 07:59:49.641152 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 465/924] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 07:59:49 2022] POST /identity/v3/auth/tokens => generated 1962 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 25 07:59:49.665075 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821f8b0-d5d9-4f91-a310-8db9af9c5f29 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:49.756242 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:49.766390 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2821f8b0-d5d9-4f91-a310-8db9af9c5f29 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:49.799360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b42f2-23e9-4b78-bfba-246794881a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:49.800624 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b42f2-23e9-4b78-bfba-246794881a4a None admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:49.800912 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b42f2-23e9-4b78-bfba-246794881a4a None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:49.801188 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1b42f2-23e9-4b78-bfba-246794881a4a None admin] PATH_INFO: `/v3/services/placement` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:49.801833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b42f2-23e9-4b78-bfba-246794881a4a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:49.803206 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1b42f2-23e9-4b78-bfba-246794881a4a None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application [None req-0d1b42f2-23e9-4b78-bfba-246794881a4a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application Traceback (most recent call last): May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 25 07:59:49.814803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._get_service(service_id) May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 25 07:59:49.816485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.get_or_create( May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application with Lock( May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self._enter() May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application return self.creator() May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application created_value = creator( May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: ERROR keystone.server.flask.application May 25 07:59:49.817505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 460/925] 10.222.0.25 () {56 vars in 1117 bytes} [Wed May 25 07:59:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 25 07:59:49.823742 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d039-130e-489d-9beb-d94851192f66 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:49.897914 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:59:49.920410 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3531d039-130e-489d-9beb-d94851192f66 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:49.953933 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bd00f3-3db7-4a4e-ac42-47080d3e011b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:49.954595 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd00f3-3db7-4a4e-ac42-47080d3e011b None admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:49.954878 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd00f3-3db7-4a4e-ac42-47080d3e011b None admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:49.955154 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bd00f3-3db7-4a4e-ac42-47080d3e011b None admin] PATH_INFO: `/v3/services` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:49.955853 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd00f3-3db7-4a4e-ac42-47080d3e011b None admin] RBAC: Adding query filter params (name=placement) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 07:59:49.956204 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd00f3-3db7-4a4e-ac42-47080d3e011b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:49.957580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bd00f3-3db7-4a4e-ac42-47080d3e011b None admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:49.962544 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 466/926] 10.222.0.25 () {56 vars in 1116 bytes} [Wed May 25 07:59:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 07:59:49.968366 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b42f2-23e9-4b78-bfba-246794881a4a None admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 07:59:50.065517 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1b42f2-23e9-4b78-bfba-246794881a4a None admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 07:59:50.098524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c77dc-0f75-4052-a359-8ad2e5161250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 07:59:50.099175 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c77dc-0f75-4052-a359-8ad2e5161250 None admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 07:59:50.099460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c77dc-0f75-4052-a359-8ad2e5161250 None admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 07:59:50.099737 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c77dc-0f75-4052-a359-8ad2e5161250 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 07:59:50.100514 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c77dc-0f75-4052-a359-8ad2e5161250 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 07:59:50.101903 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c77dc-0f75-4052-a359-8ad2e5161250 None admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 07:59:50.121012 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 461/927] 10.222.0.25 () {60 vars in 1144 bytes} [Wed May 25 07:59:49 2022] POST /identity/v3/endpoints => generated 331 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 07:59:59.959581 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=30 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:00:00.117035 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=93,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:00:51.214796 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b517-f215-4a3f-8e54-cbbeeb50e428 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:00:51.215370 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b517-f215-4a3f-8e54-cbbeeb50e428 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:00:51.215370 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9721b517-f215-4a3f-8e54-cbbeeb50e428 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:00:51.217337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 467/928] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:00:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 08:00:51.226355 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa538173-fac6-4d02-979f-513cd396c495 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:00:51.227100 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa538173-fac6-4d02-979f-513cd396c495 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:00:51.227100 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa538173-fac6-4d02-979f-513cd396c495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:00:51.265438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-fa538173-fac6-4d02-979f-513cd396c495 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:00:51.266608 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-fa538173-fac6-4d02-979f-513cd396c495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:00:51.359535 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 462/929] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:00:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:00:51.411596 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab18000-1a8f-4700-b6fe-f287aea2febb None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:00:51.411963 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab18000-1a8f-4700-b6fe-f287aea2febb None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:00:51.412563 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab18000-1a8f-4700-b6fe-f287aea2febb None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:00:51.413824 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 468/930] 10.222.0.25 () {54 vars in 964 bytes} [Wed May 25 08:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:00:51.420780 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7ac58-7f82-4dce-9c59-0114fad4e043 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:00:51.421396 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7ac58-7f82-4dce-9c59-0114fad4e043 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:00:51.421797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e7ac58-7f82-4dce-9c59-0114fad4e043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:00:51.508747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-c8e7ac58-7f82-4dce-9c59-0114fad4e043 None None] MFA Rules not processed for user `e0eaeb03cb5f487f9640938b244fe210`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:00:51.510963 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-c8e7ac58-7f82-4dce-9c59-0114fad4e043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:00:51.616680 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 463/931] 10.222.0.25 () {58 vars in 1061 bytes} [Wed May 25 08:00:51 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:00:51.626119 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab18000-1a8f-4700-b6fe-f287aea2febb None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:00:51.639546 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab18000-1a8f-4700-b6fe-f287aea2febb None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:00:51.643965 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d07875-0d7b-43f4-a9b6-17a3262275f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:00:51.644820 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d07875-0d7b-43f4-a9b6-17a3262275f8 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:00:51.644981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d07875-0d7b-43f4-a9b6-17a3262275f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:00:51.645292 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d07875-0d7b-43f4-a9b6-17a3262275f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:00:51.655530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d07875-0d7b-43f4-a9b6-17a3262275f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:00:51.657070 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d07875-0d7b-43f4-a9b6-17a3262275f8 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:00:51.674639 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 469/932] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:00:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:00:54.243714 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94845b4e-9202-4ea6-972c-930e7747de98 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:00:54.244354 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94845b4e-9202-4ea6-972c-930e7747de98 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:00:54.244457 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94845b4e-9202-4ea6-972c-930e7747de98 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:00:54.246233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 464/933] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:00:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:00:54.256007 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd1854-c84d-4366-b1dd-78120b5adce0 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:00:54.256599 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd1854-c84d-4366-b1dd-78120b5adce0 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:00:54.256599 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fd1854-c84d-4366-b1dd-78120b5adce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:00:54.276211 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-a4fd1854-c84d-4366-b1dd-78120b5adce0 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:00:54.277425 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-a4fd1854-c84d-4366-b1dd-78120b5adce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:00:54.287104 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 470/934] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:00:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:00:54.326433 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94845b4e-9202-4ea6-972c-930e7747de98 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:00:54.337441 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94845b4e-9202-4ea6-972c-930e7747de98 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:00:54.340889 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103a9695-91be-4e87-b902-9c285c66133d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:00:54.341525 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a9695-91be-4e87-b902-9c285c66133d service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:00:54.341807 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a9695-91be-4e87-b902-9c285c66133d service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:00:54.342080 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103a9695-91be-4e87-b902-9c285c66133d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:00:54.351847 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a9695-91be-4e87-b902-9c285c66133d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:00:54.353317 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103a9695-91be-4e87-b902-9c285c66133d service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:00:54.362832 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 465/935] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:00:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:00:57.012106 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703daf3-a4be-4ec0-8123-23a51a771e4f None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:00:57.012686 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703daf3-a4be-4ec0-8123-23a51a771e4f None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:00:57.012686 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e703daf3-a4be-4ec0-8123-23a51a771e4f None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:00:57.014494 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 471/936] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:00:57.020343 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556440a2-cf08-4be2-8f4e-da78130ae409 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:00:57.020797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556440a2-cf08-4be2-8f4e-da78130ae409 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:00:57.020974 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556440a2-cf08-4be2-8f4e-da78130ae409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:00:57.059868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-556440a2-cf08-4be2-8f4e-da78130ae409 None None] MFA Rules not processed for user `c037cea25a404f0783e6ef90b07a1769`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:00:57.061147 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-556440a2-cf08-4be2-8f4e-da78130ae409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:00:57.109564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:00:57.145801 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 466/937] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:00:57 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:00:57.204202 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb39727-883d-4f90-afd1-26bff60a62a4 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:00:57.204508 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb39727-883d-4f90-afd1-26bff60a62a4 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:00:57.204879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb39727-883d-4f90-afd1-26bff60a62a4 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:00:57.206449 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 472/938] 10.222.0.25 () {54 vars in 964 bytes} [Wed May 25 08:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:00:57.212829 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdaf2f-1711-4ace-a0c5-83de7f001799 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:00:57.213211 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdaf2f-1711-4ace-a0c5-83de7f001799 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:00:57.213603 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbdaf2f-1711-4ace-a0c5-83de7f001799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:00:57.233859 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-7dbdaf2f-1711-4ace-a0c5-83de7f001799 None None] MFA Rules not processed for user `e0eaeb03cb5f487f9640938b244fe210`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:00:57.235193 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-7dbdaf2f-1711-4ace-a0c5-83de7f001799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:00:57.242338 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 467/939] 10.222.0.25 () {58 vars in 1061 bytes} [Wed May 25 08:00:57 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:00:57.252079 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb39727-883d-4f90-afd1-26bff60a62a4 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:00:57.263413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb39727-883d-4f90-afd1-26bff60a62a4 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:00:57.267801 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01875130-7af6-445f-b6b1-fcb4ada04a21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:00:57.268514 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01875130-7af6-445f-b6b1-fcb4ada04a21 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:00:57.268802 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01875130-7af6-445f-b6b1-fcb4ada04a21 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:00:57.269083 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01875130-7af6-445f-b6b1-fcb4ada04a21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:00:57.279774 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01875130-7af6-445f-b6b1-fcb4ada04a21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:00:57.281276 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01875130-7af6-445f-b6b1-fcb4ada04a21 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:00:57.291908 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 473/940] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:00:57 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:00.616273 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3934ab4-b168-4d04-b180-b85b909961fb None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:00.616841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3934ab4-b168-4d04-b180-b85b909961fb None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:00.616841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3934ab4-b168-4d04-b180-b85b909961fb None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:00.618203 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 468/941] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:00.623723 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab45d7-4b8e-48d4-9a89-192487310844 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:00.624201 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab45d7-4b8e-48d4-9a89-192487310844 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:00.624330 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab45d7-4b8e-48d4-9a89-192487310844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:00.642957 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-a6ab45d7-4b8e-48d4-9a89-192487310844 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:00.644200 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-a6ab45d7-4b8e-48d4-9a89-192487310844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:00.718776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 474/942] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:00 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:00.760350 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3934ab4-b168-4d04-b180-b85b909961fb None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:00.771218 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3934ab4-b168-4d04-b180-b85b909961fb None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:00.774667 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a0eb3-3179-4ec4-ac6a-6043b9acf330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:00.775303 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a0eb3-3179-4ec4-ac6a-6043b9acf330 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:00.775586 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a0eb3-3179-4ec4-ac6a-6043b9acf330 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:00.775862 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a0eb3-3179-4ec4-ac6a-6043b9acf330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:00.786560 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a0eb3-3179-4ec4-ac6a-6043b9acf330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:00.787998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580a0eb3-3179-4ec4-ac6a-6043b9acf330 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:00.797822 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 469/943] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:00 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:04.108902 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf075d-c1c8-4c20-8ca1-00d7162ef25d None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:04.109489 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf075d-c1c8-4c20-8ca1-00d7162ef25d None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:04.109489 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbf075d-c1c8-4c20-8ca1-00d7162ef25d None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:04.111033 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 475/944] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:04.116516 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166272b-c2f8-4b68-a217-3a440bf164ea None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:04.117010 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166272b-c2f8-4b68-a217-3a440bf164ea None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:04.117146 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b166272b-c2f8-4b68-a217-3a440bf164ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:04.134862 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-b166272b-c2f8-4b68-a217-3a440bf164ea None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:04.135991 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-b166272b-c2f8-4b68-a217-3a440bf164ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:04.144678 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 470/945] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:04.183010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf075d-c1c8-4c20-8ca1-00d7162ef25d None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:04.193907 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbf075d-c1c8-4c20-8ca1-00d7162ef25d None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:04.197507 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6f02d0-0142-4fe3-81c6-88171b9f1c33 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:04.198174 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f02d0-0142-4fe3-81c6-88171b9f1c33 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:04.198462 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f02d0-0142-4fe3-81c6-88171b9f1c33 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:04.198738 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6f02d0-0142-4fe3-81c6-88171b9f1c33 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:04.209418 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f02d0-0142-4fe3-81c6-88171b9f1c33 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:04.210887 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6f02d0-0142-4fe3-81c6-88171b9f1c33 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:04.221914 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 476/946] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:06.778000 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63934a70-bcb2-40ba-901a-9b766cdcbd0b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:06.778664 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63934a70-bcb2-40ba-901a-9b766cdcbd0b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:06.778664 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63934a70-bcb2-40ba-901a-9b766cdcbd0b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:06.781117 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 471/947] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:06.788763 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b61d5e-0169-4f5f-b85f-0cb83b87c81b None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:06.789561 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b61d5e-0169-4f5f-b85f-0cb83b87c81b None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:06.789877 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b61d5e-0169-4f5f-b85f-0cb83b87c81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:06.809477 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-b1b61d5e-0169-4f5f-b85f-0cb83b87c81b None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:06.810712 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-b1b61d5e-0169-4f5f-b85f-0cb83b87c81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:06.819699 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 477/948] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:06 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:06.859946 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63934a70-bcb2-40ba-901a-9b766cdcbd0b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:06.874924 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63934a70-bcb2-40ba-901a-9b766cdcbd0b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:06.879428 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b06b43-6ad7-422f-a042-03a5de458330 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:06.880064 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b06b43-6ad7-422f-a042-03a5de458330 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:06.880411 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b06b43-6ad7-422f-a042-03a5de458330 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:06.881019 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b06b43-6ad7-422f-a042-03a5de458330 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:06.891475 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b06b43-6ad7-422f-a042-03a5de458330 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:06.893527 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b06b43-6ad7-422f-a042-03a5de458330 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:06.905639 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 472/949] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:06 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:09.509360 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d4180-0386-4214-8f16-51bf4a7c4611 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:09.509930 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d4180-0386-4214-8f16-51bf4a7c4611 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:09.509930 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d4180-0386-4214-8f16-51bf4a7c4611 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:09.511465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 478/950] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:09.517715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067393ff-0262-437b-90ef-f088088e3841 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:09.518202 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067393ff-0262-437b-90ef-f088088e3841 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:09.518318 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067393ff-0262-437b-90ef-f088088e3841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:09.537498 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-067393ff-0262-437b-90ef-f088088e3841 None None] MFA Rules not processed for user `c037cea25a404f0783e6ef90b07a1769`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:09.538695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-067393ff-0262-437b-90ef-f088088e3841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:09.547262 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 473/951] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:09 2022] POST /identity/v3/auth/tokens => generated 2793 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:09.591384 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d4180-0386-4214-8f16-51bf4a7c4611 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:09.605178 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d4180-0386-4214-8f16-51bf4a7c4611 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:09.609020 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7803b77f-c990-4390-8bc2-67b44b79ea01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:09.609678 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803b77f-c990-4390-8bc2-67b44b79ea01 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:09.609978 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803b77f-c990-4390-8bc2-67b44b79ea01 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:09.610297 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7803b77f-c990-4390-8bc2-67b44b79ea01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:09.620932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803b77f-c990-4390-8bc2-67b44b79ea01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:09.622389 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7803b77f-c990-4390-8bc2-67b44b79ea01 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:09.633226 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 479/952] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:09 2022] GET /identity/v3/auth/tokens => generated 2793 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 08:01:12.559783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e244a-7b9f-4676-9b6d-2a915631a758 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:12.560410 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e244a-7b9f-4676-9b6d-2a915631a758 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:12.560623 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19e244a-7b9f-4676-9b6d-2a915631a758 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:12.562898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 474/953] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:12.570139 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ea54a-03ca-46fb-824c-c5d73b2d77bb None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:12.570734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ea54a-03ca-46fb-824c-c5d73b2d77bb None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:12.570826 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7ea54a-03ca-46fb-824c-c5d73b2d77bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:12.591519 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-be7ea54a-03ca-46fb-824c-c5d73b2d77bb None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:12.592892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-be7ea54a-03ca-46fb-824c-c5d73b2d77bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:12.602266 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 480/954] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:12 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:12.644375 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e244a-7b9f-4676-9b6d-2a915631a758 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:12.657640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19e244a-7b9f-4676-9b6d-2a915631a758 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:12.661517 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8947e27d-0e6b-48a4-b705-fbe39b10103d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:12.662150 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947e27d-0e6b-48a4-b705-fbe39b10103d service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:12.662433 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947e27d-0e6b-48a4-b705-fbe39b10103d service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:12.662777 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8947e27d-0e6b-48a4-b705-fbe39b10103d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:12.673269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947e27d-0e6b-48a4-b705-fbe39b10103d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:12.674708 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8947e27d-0e6b-48a4-b705-fbe39b10103d service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:12.685720 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 475/955] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:12 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:15.136733 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1662cc-cec7-4a1d-8432-666590c253c6 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:15.137327 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1662cc-cec7-4a1d-8432-666590c253c6 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:15.137511 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1662cc-cec7-4a1d-8432-666590c253c6 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:15.139147 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 481/956] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:15.146887 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcba6c6-847e-4fff-bfd7-cd9ca4afac9a None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:15.147375 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcba6c6-847e-4fff-bfd7-cd9ca4afac9a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:15.147688 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcba6c6-847e-4fff-bfd7-cd9ca4afac9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:15.169904 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-0dcba6c6-847e-4fff-bfd7-cd9ca4afac9a None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:15.171448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-0dcba6c6-847e-4fff-bfd7-cd9ca4afac9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:15.179700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 476/957] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:15.222092 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1662cc-cec7-4a1d-8432-666590c253c6 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:15.232868 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1662cc-cec7-4a1d-8432-666590c253c6 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:15.236841 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2d03b5-99c1-4dcc-ae54-e586ffa93949 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:15.237480 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d03b5-99c1-4dcc-ae54-e586ffa93949 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:15.237763 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d03b5-99c1-4dcc-ae54-e586ffa93949 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:15.238040 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2d03b5-99c1-4dcc-ae54-e586ffa93949 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:15.247010 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d03b5-99c1-4dcc-ae54-e586ffa93949 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:15.248480 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2d03b5-99c1-4dcc-ae54-e586ffa93949 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:15.258534 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 482/958] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:17.880602 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931c58-2261-4dd2-ada0-8925568f3c67 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:17.880998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931c58-2261-4dd2-ada0-8925568f3c67 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:17.881159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60931c58-2261-4dd2-ada0-8925568f3c67 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:17.882550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 477/959] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:17.887783 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8642a-07cf-4b68-b4dc-554c28f58a3c None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:17.888224 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8642a-07cf-4b68-b4dc-554c28f58a3c None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:17.888378 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8642a-07cf-4b68-b4dc-554c28f58a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:17.905969 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-4ae8642a-07cf-4b68-b4dc-554c28f58a3c None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:17.907173 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-4ae8642a-07cf-4b68-b4dc-554c28f58a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:17.915441 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 483/960] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:17 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:17.951605 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60931c58-2261-4dd2-ada0-8925568f3c67 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:17.962216 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60931c58-2261-4dd2-ada0-8925568f3c67 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:17.965687 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80308a0e-9682-4e0b-a3f4-2b5204476909 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:17.966314 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80308a0e-9682-4e0b-a3f4-2b5204476909 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:17.966594 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80308a0e-9682-4e0b-a3f4-2b5204476909 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:17.966868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80308a0e-9682-4e0b-a3f4-2b5204476909 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:17.976305 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80308a0e-9682-4e0b-a3f4-2b5204476909 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:17.977734 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80308a0e-9682-4e0b-a3f4-2b5204476909 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:17.987668 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 478/961] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:17 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:22.499187 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259e665-a080-4194-9cdf-28b194fad4f3 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:22.499700 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259e665-a080-4194-9cdf-28b194fad4f3 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:22.499700 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f259e665-a080-4194-9cdf-28b194fad4f3 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:22.501160 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 484/962] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:22.507522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f05b1-7bed-418c-8d1d-856e578d638e None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:22.508098 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f05b1-7bed-418c-8d1d-856e578d638e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:22.508391 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821f05b1-7bed-418c-8d1d-856e578d638e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:22.528210 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-821f05b1-7bed-418c-8d1d-856e578d638e None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:22.529588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-821f05b1-7bed-418c-8d1d-856e578d638e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:22.538506 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 479/963] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:22.581207 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259e665-a080-4194-9cdf-28b194fad4f3 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:22.586727 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=74 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:01:22.593343 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f259e665-a080-4194-9cdf-28b194fad4f3 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:22.597478 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c9d69a-88be-475e-82f7-6cc739665773 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:22.598200 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9d69a-88be-475e-82f7-6cc739665773 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:22.598555 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9d69a-88be-475e-82f7-6cc739665773 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:22.598902 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c9d69a-88be-475e-82f7-6cc739665773 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:22.608168 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9d69a-88be-475e-82f7-6cc739665773 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:22.609606 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c9d69a-88be-475e-82f7-6cc739665773 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:22.619795 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 485/964] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:25.617063 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a239864-0c29-4d8b-ba79-789f85e55143 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:25.617651 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a239864-0c29-4d8b-ba79-789f85e55143 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:25.617651 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a239864-0c29-4d8b-ba79-789f85e55143 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:25.618970 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 480/965] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:25.624394 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b889820-696e-4248-bea8-ab0baef06950 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:25.624855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b889820-696e-4248-bea8-ab0baef06950 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:25.625000 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b889820-696e-4248-bea8-ab0baef06950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:25.643416 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-1b889820-696e-4248-bea8-ab0baef06950 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:25.644879 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-1b889820-696e-4248-bea8-ab0baef06950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:25.652951 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 486/966] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:25 2022] POST /identity/v3/auth/tokens => generated 2788 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:25.691387 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a239864-0c29-4d8b-ba79-789f85e55143 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:25.702137 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a239864-0c29-4d8b-ba79-789f85e55143 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:25.705803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecb3846-df73-4507-b3f7-80fdb48defe9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:25.706445 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb3846-df73-4507-b3f7-80fdb48defe9 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:25.706799 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb3846-df73-4507-b3f7-80fdb48defe9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:25.707077 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecb3846-df73-4507-b3f7-80fdb48defe9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:25.717040 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb3846-df73-4507-b3f7-80fdb48defe9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:25.718509 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecb3846-df73-4507-b3f7-80fdb48defe9 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:25.729417 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 481/967] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:25 2022] GET /identity/v3/auth/tokens => generated 2788 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:30.208929 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97541e-18a4-4a33-a20c-d323149fba18 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:30.209550 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97541e-18a4-4a33-a20c-d323149fba18 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:30.209550 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe97541e-18a4-4a33-a20c-d323149fba18 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:30.210851 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 487/968] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:30.216416 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f2d9-a5c4-475b-be49-fb5222cca178 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:30.216879 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f2d9-a5c4-475b-be49-fb5222cca178 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:30.216992 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a26f2d9-a5c4-475b-be49-fb5222cca178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:30.223749 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=57 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:01:30.237525 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-5a26f2d9-a5c4-475b-be49-fb5222cca178 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:30.238762 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-5a26f2d9-a5c4-475b-be49-fb5222cca178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:30.246793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 482/969] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:30 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:30.289115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97541e-18a4-4a33-a20c-d323149fba18 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:30.300991 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe97541e-18a4-4a33-a20c-d323149fba18 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:30.304383 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f725b9c1-3739-46fc-9f8f-392698b0633a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:30.305061 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725b9c1-3739-46fc-9f8f-392698b0633a service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:30.305348 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725b9c1-3739-46fc-9f8f-392698b0633a service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:30.305654 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f725b9c1-3739-46fc-9f8f-392698b0633a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:30.315490 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725b9c1-3739-46fc-9f8f-392698b0633a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:30.316986 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f725b9c1-3739-46fc-9f8f-392698b0633a service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:30.328016 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 488/970] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:30 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:36.025988 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594fadc-4652-4422-bf6e-b49fcd349f69 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:36.026953 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594fadc-4652-4422-bf6e-b49fcd349f69 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:36.027505 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594fadc-4652-4422-bf6e-b49fcd349f69 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:36.029506 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 483/971] 10.222.0.25 () {54 vars in 921 bytes} [Wed May 25 08:01:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:36.035563 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eee47-7f62-4e73-a305-fca96db68ef4 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:36.036441 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eee47-7f62-4e73-a305-fca96db68ef4 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:36.036931 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113eee47-7f62-4e73-a305-fca96db68ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:36.082016 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-113eee47-7f62-4e73-a305-fca96db68ef4 None None] MFA Rules not processed for user `852fb6ed2a764a7db2c2497980c2e06f`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:36.083441 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-113eee47-7f62-4e73-a305-fca96db68ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:36.176302 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 489/972] 10.222.0.25 () {58 vars in 1018 bytes} [Wed May 25 08:01:36 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:40.231511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=2 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:01:40.752762 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3408935-08e7-43f5-9e63-2ecba5dd48ca None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:40.753149 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3408935-08e7-43f5-9e63-2ecba5dd48ca None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:40.753515 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3408935-08e7-43f5-9e63-2ecba5dd48ca None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:40.755003 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 484/973] 10.222.0.25 () {54 vars in 921 bytes} [Wed May 25 08:01:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:40.761780 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae4cd8-3be7-470a-921e-a8a3764be618 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:40.762456 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae4cd8-3be7-470a-921e-a8a3764be618 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:40.762456 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adae4cd8-3be7-470a-921e-a8a3764be618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:40.782978 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-adae4cd8-3be7-470a-921e-a8a3764be618 None None] MFA Rules not processed for user `852fb6ed2a764a7db2c2497980c2e06f`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:40.784235 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-adae4cd8-3be7-470a-921e-a8a3764be618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:40.793102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 490/974] 10.222.0.25 () {58 vars in 1018 bytes} [Wed May 25 08:01:40 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:42.714127 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057adb1e-d069-4f5c-a62e-75a09f93cf9d None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:42.714662 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057adb1e-d069-4f5c-a62e-75a09f93cf9d None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:42.714662 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057adb1e-d069-4f5c-a62e-75a09f93cf9d None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:42.716034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 485/975] 10.222.0.25 () {54 vars in 921 bytes} [Wed May 25 08:01:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:42.721204 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac436dc-4b2f-4d2d-8df9-671f8255a5ad None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:42.721718 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac436dc-4b2f-4d2d-8df9-671f8255a5ad None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:42.721838 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac436dc-4b2f-4d2d-8df9-671f8255a5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:42.739776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-7ac436dc-4b2f-4d2d-8df9-671f8255a5ad None None] MFA Rules not processed for user `852fb6ed2a764a7db2c2497980c2e06f`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:42.740995 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-7ac436dc-4b2f-4d2d-8df9-671f8255a5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:42.749344 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 491/976] 10.222.0.25 () {58 vars in 1018 bytes} [Wed May 25 08:01:42 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:46.531949 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088ab28-4d44-47c9-9c25-a1ec044fdd09 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:46.532605 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088ab28-4d44-47c9-9c25-a1ec044fdd09 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:46.532605 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088ab28-4d44-47c9-9c25-a1ec044fdd09 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:46.533991 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 486/977] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:46.539297 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa552c94-e395-4e7b-a0d0-b7fb3da37d83 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:46.539744 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa552c94-e395-4e7b-a0d0-b7fb3da37d83 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:46.539836 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa552c94-e395-4e7b-a0d0-b7fb3da37d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:46.558069 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-aa552c94-e395-4e7b-a0d0-b7fb3da37d83 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:46.559256 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-aa552c94-e395-4e7b-a0d0-b7fb3da37d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:46.568318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 492/978] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:46.623661 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aad32-c118-46f7-97b1-126ce38ded2c None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:46.623947 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aad32-c118-46f7-97b1-126ce38ded2c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:46.624258 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777aad32-c118-46f7-97b1-126ce38ded2c None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:46.626436 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 487/979] 10.222.0.25 () {54 vars in 961 bytes} [Wed May 25 08:01:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:46.634892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7f84a-4ba2-4393-96a1-f1c94deda820 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:46.635208 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7f84a-4ba2-4393-96a1-f1c94deda820 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:46.635496 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7f84a-4ba2-4393-96a1-f1c94deda820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:46.682167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-eef7f84a-4ba2-4393-96a1-f1c94deda820 None None] MFA Rules not processed for user `0b9bc11432e04e779fffd35473e6fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:46.683707 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-eef7f84a-4ba2-4393-96a1-f1c94deda820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:46.754507 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=100 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:01:46.761922 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 493/980] 10.222.0.25 () {58 vars in 1058 bytes} [Wed May 25 08:01:46 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:46.769598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aad32-c118-46f7-97b1-126ce38ded2c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:46.787727 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777aad32-c118-46f7-97b1-126ce38ded2c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:46.792806 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac41d63d-4ada-4023-91fa-4d57f77a91fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:46.793373 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41d63d-4ada-4023-91fa-4d57f77a91fd service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:46.793701 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41d63d-4ada-4023-91fa-4d57f77a91fd service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:46.793979 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41d63d-4ada-4023-91fa-4d57f77a91fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:46.803460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41d63d-4ada-4023-91fa-4d57f77a91fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:46.805080 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac41d63d-4ada-4023-91fa-4d57f77a91fd service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:46.815166 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 488/981] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 08:01:49.337062 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640c0a-cc45-405c-aa28-b8734ce8f4c0 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:49.337624 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640c0a-cc45-405c-aa28-b8734ce8f4c0 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:49.337624 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06640c0a-cc45-405c-aa28-b8734ce8f4c0 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:49.339034 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 494/982] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:49.345737 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88917c9d-fb4e-43ef-849d-115e808332bb None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:49.346259 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88917c9d-fb4e-43ef-849d-115e808332bb None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:49.346337 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88917c9d-fb4e-43ef-849d-115e808332bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:49.365240 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-88917c9d-fb4e-43ef-849d-115e808332bb None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:49.366448 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-88917c9d-fb4e-43ef-849d-115e808332bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:49.374631 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 489/983] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:49 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 08:01:49.422516 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06640c0a-cc45-405c-aa28-b8734ce8f4c0 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:49.436588 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06640c0a-cc45-405c-aa28-b8734ce8f4c0 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:49.442503 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f004e373-ae93-4537-b93d-5f5f0fb8be07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:49.443274 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e373-ae93-4537-b93d-5f5f0fb8be07 service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:49.443655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e373-ae93-4537-b93d-5f5f0fb8be07 service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:49.444028 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f004e373-ae93-4537-b93d-5f5f0fb8be07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:49.453008 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004e373-ae93-4537-b93d-5f5f0fb8be07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:49.455337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f004e373-ae93-4537-b93d-5f5f0fb8be07 service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:49.465734 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 495/984] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:52.116793 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aa704-1c9f-4dcc-a5c8-c081befb3d19 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:52.117702 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aa704-1c9f-4dcc-a5c8-c081befb3d19 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:52.117702 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4aa704-1c9f-4dcc-a5c8-c081befb3d19 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:52.118745 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 490/985] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 08:01:52.124828 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760a3a1-941e-42ae-a9fe-d60cc4a61dd4 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:52.126099 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760a3a1-941e-42ae-a9fe-d60cc4a61dd4 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:52.126099 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2760a3a1-941e-42ae-a9fe-d60cc4a61dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:52.153387 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-2760a3a1-941e-42ae-a9fe-d60cc4a61dd4 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:52.154632 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-2760a3a1-941e-42ae-a9fe-d60cc4a61dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:52.164073 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 496/986] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 08:01:52.241038 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823b99a-2c06-4408-94f7-c0314d961407 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:52.241323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823b99a-2c06-4408-94f7-c0314d961407 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:52.241605 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f823b99a-2c06-4408-94f7-c0314d961407 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:52.242978 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 491/987] 10.222.0.25 () {54 vars in 961 bytes} [Wed May 25 08:01:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:52.250402 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3772ec-1afe-4d2b-a6f2-d0a1a76cb31d None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:52.250739 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3772ec-1afe-4d2b-a6f2-d0a1a76cb31d None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:52.250983 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3772ec-1afe-4d2b-a6f2-d0a1a76cb31d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:52.270200 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-cf3772ec-1afe-4d2b-a6f2-d0a1a76cb31d None None] MFA Rules not processed for user `0b9bc11432e04e779fffd35473e6fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:52.271410 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-cf3772ec-1afe-4d2b-a6f2-d0a1a76cb31d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:52.281236 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 497/988] 10.222.0.25 () {58 vars in 1058 bytes} [Wed May 25 08:01:52 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:52.289921 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823b99a-2c06-4408-94f7-c0314d961407 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:52.304956 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f823b99a-2c06-4408-94f7-c0314d961407 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:52.311375 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6427faa4-c022-4f38-a94d-76f3b73acd6c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:52.312041 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427faa4-c022-4f38-a94d-76f3b73acd6c service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:52.312353 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427faa4-c022-4f38-a94d-76f3b73acd6c service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:52.312654 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6427faa4-c022-4f38-a94d-76f3b73acd6c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:52.324292 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427faa4-c022-4f38-a94d-76f3b73acd6c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:52.326483 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6427faa4-c022-4f38-a94d-76f3b73acd6c service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:52.342432 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 492/989] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:52 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 08:01:54.742908 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e708084-29e0-4bc5-87d8-0b880369e57a None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:54.743767 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e708084-29e0-4bc5-87d8-0b880369e57a None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:54.744248 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e708084-29e0-4bc5-87d8-0b880369e57a None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:54.746052 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 498/990] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:54.753871 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092948c-bc99-4049-a573-72724642d73c None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:54.754714 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092948c-bc99-4049-a573-72724642d73c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:54.755151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6092948c-bc99-4049-a573-72724642d73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:54.777240 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-6092948c-bc99-4049-a573-72724642d73c None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:54.778866 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-6092948c-bc99-4049-a573-72724642d73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:54.792569 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 493/991] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:54.836445 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e708084-29e0-4bc5-87d8-0b880369e57a None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:54.851332 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e708084-29e0-4bc5-87d8-0b880369e57a None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:54.856890 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f43636-4564-4415-a9a1-d5f331945976 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:54.857735 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f43636-4564-4415-a9a1-d5f331945976 service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:54.858192 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f43636-4564-4415-a9a1-d5f331945976 service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:54.858614 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f43636-4564-4415-a9a1-d5f331945976 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:54.868351 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f43636-4564-4415-a9a1-d5f331945976 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:54.870174 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f43636-4564-4415-a9a1-d5f331945976 service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:54.896946 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 499/992] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:57.362231 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070ee6-34fd-41c0-969b-afb7dd7d6ad9 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:57.362836 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070ee6-34fd-41c0-969b-afb7dd7d6ad9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:57.362836 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70070ee6-34fd-41c0-969b-afb7dd7d6ad9 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:57.364408 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 494/993] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:57.370629 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0e862-b515-47d4-9a96-8000477d64e3 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:57.371186 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0e862-b515-47d4-9a96-8000477d64e3 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:57.371186 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d0e862-b515-47d4-9a96-8000477d64e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:57.393047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-78d0e862-b515-47d4-9a96-8000477d64e3 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:57.394655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-78d0e862-b515-47d4-9a96-8000477d64e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:57.403630 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 500/994] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 08:01:57.451269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070ee6-34fd-41c0-969b-afb7dd7d6ad9 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:57.466351 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70070ee6-34fd-41c0-969b-afb7dd7d6ad9 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:57.471537 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dc71c6-b0d7-41e8-ae8a-28a7509e6b79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:57.472268 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc71c6-b0d7-41e8-ae8a-28a7509e6b79 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:57.472561 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc71c6-b0d7-41e8-ae8a-28a7509e6b79 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:57.472842 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dc71c6-b0d7-41e8-ae8a-28a7509e6b79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:57.482136 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc71c6-b0d7-41e8-ae8a-28a7509e6b79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:57.483764 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dc71c6-b0d7-41e8-ae8a-28a7509e6b79 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:57.495149 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 495/995] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:57.961363 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75d0e3-9960-42da-86be-a459c49a3f1c None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:57.961583 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75d0e3-9960-42da-86be-a459c49a3f1c None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:57.961848 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee75d0e3-9960-42da-86be-a459c49a3f1c None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:57.963475 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 501/996] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:57.968623 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d866-430c-4812-a4ab-9aea3be2ff7a None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:57.968958 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d866-430c-4812-a4ab-9aea3be2ff7a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:57.969237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e9d866-430c-4812-a4ab-9aea3be2ff7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:57.988510 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-39e9d866-430c-4812-a4ab-9aea3be2ff7a None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:57.989720 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-39e9d866-430c-4812-a4ab-9aea3be2ff7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:58.008451 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 496/997] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:58.306501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fb8fd-1724-4670-b753-c10379ef3360 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:58.306501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fb8fd-1724-4670-b753-c10379ef3360 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:58.306501 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4fb8fd-1724-4670-b753-c10379ef3360 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:58.310823 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 502/998] 10.222.0.25 () {54 vars in 963 bytes} [Wed May 25 08:01:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:58.317250 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eab114-e893-4211-b35b-c4d38269469b None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:58.317671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eab114-e893-4211-b35b-c4d38269469b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:58.318048 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69eab114-e893-4211-b35b-c4d38269469b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:58.362489 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-69eab114-e893-4211-b35b-c4d38269469b None None] MFA Rules not processed for user `051dfda2a77e4648ae1f5ee47296499d`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:58.363893 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-69eab114-e893-4211-b35b-c4d38269469b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:58.433157 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 497/999] 10.222.0.25 () {58 vars in 1060 bytes} [Wed May 25 08:01:58 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:01:58.440634 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fb8fd-1724-4670-b753-c10379ef3360 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:01:58.452062 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4fb8fd-1724-4670-b753-c10379ef3360 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:01:58.456620 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df65fac-e736-476a-987f-3adc44cd0b9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051dfda2a77e4648ae1f5ee47296499d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:01:58.457266 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df65fac-e736-476a-987f-3adc44cd0b9f service cinder] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:58.457549 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df65fac-e736-476a-987f-3adc44cd0b9f service cinder] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:58.457997 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df65fac-e736-476a-987f-3adc44cd0b9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:58.471729 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df65fac-e736-476a-987f-3adc44cd0b9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:01:58.473175 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df65fac-e736-476a-987f-3adc44cd0b9f service cinder] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:01:58.487969 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 503/1000] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:01:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:01:59.927626 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e655091-cc5d-4abc-9da4-80cda8f56cf6 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:59.928215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e655091-cc5d-4abc-9da4-80cda8f56cf6 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:59.928215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e655091-cc5d-4abc-9da4-80cda8f56cf6 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:59.929598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 498/1001] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:01:59.934981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bbf38-95d2-4546-bf2b-1ce7a9d3e1ca None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:01:59.935446 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bbf38-95d2-4546-bf2b-1ce7a9d3e1ca None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:01:59.935555 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052bbf38-95d2-4546-bf2b-1ce7a9d3e1ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:01:59.955958 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-052bbf38-95d2-4546-bf2b-1ce7a9d3e1ca None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:01:59.957201 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-052bbf38-95d2-4546-bf2b-1ce7a9d3e1ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:01:59.965067 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 504/1002] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:01:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:00.011890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e655091-cc5d-4abc-9da4-80cda8f56cf6 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:00.026037 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e655091-cc5d-4abc-9da4-80cda8f56cf6 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:00.031960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dfa2bc-8930-45ba-808d-0303225b0b0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:00.032791 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfa2bc-8930-45ba-808d-0303225b0b0b service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:00.033151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfa2bc-8930-45ba-808d-0303225b0b0b service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:00.033433 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dfa2bc-8930-45ba-808d-0303225b0b0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:00.042199 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfa2bc-8930-45ba-808d-0303225b0b0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:00.043823 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dfa2bc-8930-45ba-808d-0303225b0b0b service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:00.054461 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 499/1003] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:02.504402 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff0a08-c126-4ceb-b0a4-ce072c3c73de None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:02.505258 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff0a08-c126-4ceb-b0a4-ce072c3c73de None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:02.505700 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdff0a08-c126-4ceb-b0a4-ce072c3c73de None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:02.507542 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 505/1004] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:02:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:02.516205 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd7935-8078-44f8-99ca-e7e64a2bd907 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:02.517579 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd7935-8078-44f8-99ca-e7e64a2bd907 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:02.518298 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd7935-8078-44f8-99ca-e7e64a2bd907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:02.543504 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-88bd7935-8078-44f8-99ca-e7e64a2bd907 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:02.544971 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-88bd7935-8078-44f8-99ca-e7e64a2bd907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:02.554136 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 500/1005] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:02:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 08:02:02.619970 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff0a08-c126-4ceb-b0a4-ce072c3c73de None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:02.649277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdff0a08-c126-4ceb-b0a4-ce072c3c73de None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:02.658040 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00646ced-7660-44d2-be74-32d336d63f48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:02.659220 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00646ced-7660-44d2-be74-32d336d63f48 service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:02.659691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00646ced-7660-44d2-be74-32d336d63f48 service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:02.660188 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00646ced-7660-44d2-be74-32d336d63f48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:02.685357 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00646ced-7660-44d2-be74-32d336d63f48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:02.687523 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00646ced-7660-44d2-be74-32d336d63f48 service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:02.712791 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 506/1006] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:05.416919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb75911-e888-4624-b976-e49226779764 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:05.417697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb75911-e888-4624-b976-e49226779764 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:05.418057 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb75911-e888-4624-b976-e49226779764 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:05.420960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 501/1007] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:02:05 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:05.428108 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fc971-872b-43a2-81be-1e3dd70b0858 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:05.428947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fc971-872b-43a2-81be-1e3dd70b0858 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:05.428947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972fc971-872b-43a2-81be-1e3dd70b0858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:05.456873 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-972fc971-872b-43a2-81be-1e3dd70b0858 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:05.458954 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-972fc971-872b-43a2-81be-1e3dd70b0858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:05.469589 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 507/1008] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:02:05 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:05.527086 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb75911-e888-4624-b976-e49226779764 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:05.552619 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb75911-e888-4624-b976-e49226779764 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:05.561719 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41809b2a-e639-4d1e-9a4b-be40d65d8d2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:05.563325 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809b2a-e639-4d1e-9a4b-be40d65d8d2c service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:05.563767 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809b2a-e639-4d1e-9a4b-be40d65d8d2c service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:05.564251 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41809b2a-e639-4d1e-9a4b-be40d65d8d2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:05.580959 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41809b2a-e639-4d1e-9a4b-be40d65d8d2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:05.583936 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41809b2a-e639-4d1e-9a4b-be40d65d8d2c service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:05.603693 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 502/1009] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:05 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 08:02:08.388826 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba841a-8dfe-42d2-a278-64f2d9bafcde None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:08.389691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba841a-8dfe-42d2-a278-64f2d9bafcde None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:08.389943 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ba841a-8dfe-42d2-a278-64f2d9bafcde None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:08.392449 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 508/1010] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:02:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 08:02:08.399828 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c33a-caae-4d69-a707-a028bbfb2967 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:08.400645 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c33a-caae-4d69-a707-a028bbfb2967 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:08.400645 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734c33a-caae-4d69-a707-a028bbfb2967 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:08.426309 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-8734c33a-caae-4d69-a707-a028bbfb2967 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:08.428540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8734c33a-caae-4d69-a707-a028bbfb2967 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:08.439458 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 503/1011] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:02:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:08.523772 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba841a-8dfe-42d2-a278-64f2d9bafcde None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:08.541632 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ba841a-8dfe-42d2-a278-64f2d9bafcde None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:08.548381 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a46f51-29e2-4ee3-bbd3-6fe46c5067b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:08.549464 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a46f51-29e2-4ee3-bbd3-6fe46c5067b5 service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:08.550115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a46f51-29e2-4ee3-bbd3-6fe46c5067b5 service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:08.550599 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a46f51-29e2-4ee3-bbd3-6fe46c5067b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:08.564819 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a46f51-29e2-4ee3-bbd3-6fe46c5067b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:08.567202 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a46f51-29e2-4ee3-bbd3-6fe46c5067b5 service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:08.585968 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 509/1012] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:11.681366 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4dc7-80b9-40fb-82cb-8958f175263a None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:11.690496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4dc7-80b9-40fb-82cb-8958f175263a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:11.690496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c4dc7-80b9-40fb-82cb-8958f175263a None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:11.690496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 504/1013] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:02:11 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:11.692346 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b16e7-7c37-4553-9f1f-93414e2beb23 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:11.692881 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b16e7-7c37-4553-9f1f-93414e2beb23 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:11.693032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b16e7-7c37-4553-9f1f-93414e2beb23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:11.722460 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-d48b16e7-7c37-4553-9f1f-93414e2beb23 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:11.723863 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-d48b16e7-7c37-4553-9f1f-93414e2beb23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:11.733942 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 510/1014] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:02:11 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 08:02:11.784158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c4dc7-80b9-40fb-82cb-8958f175263a None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:11.793246 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=79 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:02:11.803851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c4dc7-80b9-40fb-82cb-8958f175263a None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:11.811485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3051139-e2ff-4575-96be-4313273dcdbb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:11.812966 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3051139-e2ff-4575-96be-4313273dcdbb service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:11.813380 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3051139-e2ff-4575-96be-4313273dcdbb service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:11.813812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3051139-e2ff-4575-96be-4313273dcdbb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:11.825507 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3051139-e2ff-4575-96be-4313273dcdbb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:11.827308 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3051139-e2ff-4575-96be-4313273dcdbb service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:11.841996 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 505/1015] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:11 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:15.225310 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277c03f-a0be-4e11-be88-338c4e65926c None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:15.226077 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277c03f-a0be-4e11-be88-338c4e65926c None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:15.226077 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3277c03f-a0be-4e11-be88-338c4e65926c None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:15.227290 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 511/1016] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:15.232987 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914b36d-f104-40a7-8ca0-7ae60a6e711e None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:15.233515 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914b36d-f104-40a7-8ca0-7ae60a6e711e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:15.233607 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5914b36d-f104-40a7-8ca0-7ae60a6e711e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:15.254637 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-5914b36d-f104-40a7-8ca0-7ae60a6e711e None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:15.255854 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-5914b36d-f104-40a7-8ca0-7ae60a6e711e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:15.263761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 506/1017] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:02:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:15.311277 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277c03f-a0be-4e11-be88-338c4e65926c None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:15.324614 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3277c03f-a0be-4e11-be88-338c4e65926c None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:15.330260 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a81dd71-3dbe-46c7-8795-0da399541657 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:15.330914 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81dd71-3dbe-46c7-8795-0da399541657 service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:15.331205 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81dd71-3dbe-46c7-8795-0da399541657 service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:15.331486 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a81dd71-3dbe-46c7-8795-0da399541657 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:15.340037 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81dd71-3dbe-46c7-8795-0da399541657 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:15.341664 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a81dd71-3dbe-46c7-8795-0da399541657 service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:15.351749 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 512/1018] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:15 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:15.972158 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d50ab-0694-4864-a15b-2e3a0981014a None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:15.972450 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d50ab-0694-4864-a15b-2e3a0981014a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:15.972738 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d50ab-0694-4864-a15b-2e3a0981014a None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:15.974109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 507/1019] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:02:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 08:02:15.979494 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb902f-9cb8-4d3e-ae73-67c34277ab09 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:15.979785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb902f-9cb8-4d3e-ae73-67c34277ab09 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:15.980066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bacb902f-9cb8-4d3e-ae73-67c34277ab09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:15.999019 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-bacb902f-9cb8-4d3e-ae73-67c34277ab09 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:16.001009 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-bacb902f-9cb8-4d3e-ae73-67c34277ab09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:16.009736 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 513/1020] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:02:15 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:16.068091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702124-ac38-456c-8d8b-9268408d9999 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:16.068363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702124-ac38-456c-8d8b-9268408d9999 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:16.068652 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97702124-ac38-456c-8d8b-9268408d9999 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:16.070018 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 508/1021] 10.222.0.25 () {54 vars in 962 bytes} [Wed May 25 08:02:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:16.075074 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88e60-d2ea-46e1-be3a-28453eb0ef19 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:16.075433 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88e60-d2ea-46e1-be3a-28453eb0ef19 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:16.075785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c88e60-d2ea-46e1-be3a-28453eb0ef19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:16.113042 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-59c88e60-d2ea-46e1-be3a-28453eb0ef19 None None] MFA Rules not processed for user `6ca17baadab7473c81d80597fc0fa0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:16.114333 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-59c88e60-d2ea-46e1-be3a-28453eb0ef19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:16.175589 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 514/1022] 10.222.0.25 () {58 vars in 1059 bytes} [Wed May 25 08:02:16 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:16.182930 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97702124-ac38-456c-8d8b-9268408d9999 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:16.194702 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97702124-ac38-456c-8d8b-9268408d9999 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:16.202132 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ddf450-3cf0-47d3-af75-806fc19cb36e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca17baadab7473c81d80597fc0fa0f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:16.202880 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddf450-3cf0-47d3-af75-806fc19cb36e service glance] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:16.203168 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddf450-3cf0-47d3-af75-806fc19cb36e service glance] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:16.203478 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ddf450-3cf0-47d3-af75-806fc19cb36e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:16.213381 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddf450-3cf0-47d3-af75-806fc19cb36e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:16.214839 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ddf450-3cf0-47d3-af75-806fc19cb36e service glance] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:16.225037 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 509/1023] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:16 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:17.704794 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff33f4d-b4db-45a0-ba29-01fbb816abf7 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:17.705487 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff33f4d-b4db-45a0-ba29-01fbb816abf7 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:17.705629 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff33f4d-b4db-45a0-ba29-01fbb816abf7 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:17.707088 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 515/1024] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:02:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:17.712500 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59488ec-b450-40ae-908c-f80caefbf39c None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:17.713022 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59488ec-b450-40ae-908c-f80caefbf39c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:17.713132 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59488ec-b450-40ae-908c-f80caefbf39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:17.732205 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-c59488ec-b450-40ae-908c-f80caefbf39c None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:17.732205 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-c59488ec-b450-40ae-908c-f80caefbf39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:17.740681 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 510/1025] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:02:17 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:17.790569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff33f4d-b4db-45a0-ba29-01fbb816abf7 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:17.798518 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=92 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:02:17.805683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff33f4d-b4db-45a0-ba29-01fbb816abf7 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:17.810979 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c3ca8-11b9-4d31-9c91-c46cc086540b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:17.811664 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c3ca8-11b9-4d31-9c91-c46cc086540b service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:17.814162 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c3ca8-11b9-4d31-9c91-c46cc086540b service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:17.814162 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c3ca8-11b9-4d31-9c91-c46cc086540b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:17.821978 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c3ca8-11b9-4d31-9c91-c46cc086540b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:17.823571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c3ca8-11b9-4d31-9c91-c46cc086540b service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:17.834603 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 516/1026] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:17 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:27.725414 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=17 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:02:27.830042 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=5 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:02:31.792698 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13a462-0b12-4a35-9cf2-ba0c2049094c None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:31.793327 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13a462-0b12-4a35-9cf2-ba0c2049094c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:31.793327 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d13a462-0b12-4a35-9cf2-ba0c2049094c None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:31.794609 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 511/1027] 10.222.0.25 () {54 vars in 918 bytes} [Wed May 25 08:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:31.800925 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a4622-f594-4efb-9d93-dc9797b3c256 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:31.801497 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a4622-f594-4efb-9d93-dc9797b3c256 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:31.801497 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4a4622-f594-4efb-9d93-dc9797b3c256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:31.822224 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-5e4a4622-f594-4efb-9d93-dc9797b3c256 None None] MFA Rules not processed for user `852fb6ed2a764a7db2c2497980c2e06f`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:31.823466 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-5e4a4622-f594-4efb-9d93-dc9797b3c256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:31.839831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 517/1028] 10.222.0.25 () {58 vars in 1015 bytes} [Wed May 25 08:02:31 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:31.855613 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c1264-3960-41a6-9346-bd307de2aa41 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:31.855907 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c1264-3960-41a6-9346-bd307de2aa41 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:31.856227 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c1264-3960-41a6-9346-bd307de2aa41 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:31.857578 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 512/1029] 10.222.0.25 () {54 vars in 918 bytes} [Wed May 25 08:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:31.863079 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234e6d4-0c55-43f6-bdc0-a19cf2791d48 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:31.863367 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234e6d4-0c55-43f6-bdc0-a19cf2791d48 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:31.863646 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c234e6d4-0c55-43f6-bdc0-a19cf2791d48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:31.882567 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-c234e6d4-0c55-43f6-bdc0-a19cf2791d48 None None] MFA Rules not processed for user `0b9bc11432e04e779fffd35473e6fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:31.883792 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-c234e6d4-0c55-43f6-bdc0-a19cf2791d48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:31.893136 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 518/1030] 10.222.0.25 () {58 vars in 1015 bytes} [Wed May 25 08:02:31 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:34.739012 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e94c0-513b-4fe0-8233-d9958667deb9 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:34.739597 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e94c0-513b-4fe0-8233-d9958667deb9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:34.739597 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96e94c0-513b-4fe0-8233-d9958667deb9 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:34.740957 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 513/1031] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:02:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:34.746566 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6678f-69f1-47d3-a092-28af9656a27d None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:34.747032 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6678f-69f1-47d3-a092-28af9656a27d None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:34.747147 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd6678f-69f1-47d3-a092-28af9656a27d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:34.765750 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-2cd6678f-69f1-47d3-a092-28af9656a27d None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:34.766949 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-2cd6678f-69f1-47d3-a092-28af9656a27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:34.774735 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 519/1032] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:02:34 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:34.820496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e94c0-513b-4fe0-8233-d9958667deb9 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:34.834642 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96e94c0-513b-4fe0-8233-d9958667deb9 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:34.839625 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0e4aa-9abb-4738-9944-1914cbb2cc70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:34.840302 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0e4aa-9abb-4738-9944-1914cbb2cc70 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:34.840591 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0e4aa-9abb-4738-9944-1914cbb2cc70 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:34.840872 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0e4aa-9abb-4738-9944-1914cbb2cc70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:34.849966 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0e4aa-9abb-4738-9944-1914cbb2cc70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:34.851562 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0e4aa-9abb-4738-9944-1914cbb2cc70 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:34.861146 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 514/1033] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:34 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 08:02:35.910514 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215825-13c1-4964-9ea7-b19338d531bd None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:35.911102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215825-13c1-4964-9ea7-b19338d531bd None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:35.911102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84215825-13c1-4964-9ea7-b19338d531bd None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:35.912515 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 520/1034] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 08:02:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:35.918206 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03277588-accd-4622-9a09-08b66fff9952 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:35.918777 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03277588-accd-4622-9a09-08b66fff9952 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:35.919070 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03277588-accd-4622-9a09-08b66fff9952 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:35.940559 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-03277588-accd-4622-9a09-08b66fff9952 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:35.941833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-03277588-accd-4622-9a09-08b66fff9952 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:35.949908 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 515/1035] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 08:02:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:36.144608 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215825-13c1-4964-9ea7-b19338d531bd None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:36.158674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84215825-13c1-4964-9ea7-b19338d531bd None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:36.163677 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916da904-aff2-4d04-80a6-e9b48647d8d3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:36.164370 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916da904-aff2-4d04-80a6-e9b48647d8d3 service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:36.164658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916da904-aff2-4d04-80a6-e9b48647d8d3 service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:36.164938 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916da904-aff2-4d04-80a6-e9b48647d8d3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:36.174084 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916da904-aff2-4d04-80a6-e9b48647d8d3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:36.175689 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916da904-aff2-4d04-80a6-e9b48647d8d3 service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:36.185309 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 521/1036] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:37.142891 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e444b1-86e8-419f-b836-213931b1508a None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:37.143465 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e444b1-86e8-419f-b836-213931b1508a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:37.143465 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e444b1-86e8-419f-b836-213931b1508a None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:37.144865 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 516/1037] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 08:02:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:37.149745 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35d351-0b3a-4614-b57b-c53327c77c37 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:37.150172 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35d351-0b3a-4614-b57b-c53327c77c37 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:37.150306 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c35d351-0b3a-4614-b57b-c53327c77c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:37.168403 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-7c35d351-0b3a-4614-b57b-c53327c77c37 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:37.169598 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-7c35d351-0b3a-4614-b57b-c53327c77c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:37.177610 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 522/1038] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 08:02:37 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:37.341581 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e444b1-86e8-419f-b836-213931b1508a None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:37.355469 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e444b1-86e8-419f-b836-213931b1508a None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:37.360392 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ad0bc9-62fc-49bc-a8da-520fd8722125 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:37.361032 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0bc9-62fc-49bc-a8da-520fd8722125 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:37.361318 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0bc9-62fc-49bc-a8da-520fd8722125 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:37.361597 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ad0bc9-62fc-49bc-a8da-520fd8722125 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:37.369861 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad0bc9-62fc-49bc-a8da-520fd8722125 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:37.371441 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ad0bc9-62fc-49bc-a8da-520fd8722125 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:37.381350 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 517/1039] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:37 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:38.301529 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695af52-c4d5-4b01-ae8e-de7ed6e929fe None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:38.302098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695af52-c4d5-4b01-ae8e-de7ed6e929fe None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:38.302098 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2695af52-c4d5-4b01-ae8e-de7ed6e929fe None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:38.303486 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 523/1040] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 08:02:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:38.308800 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f07206-bc01-4137-b4e9-9e059218c4f9 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:38.309364 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f07206-bc01-4137-b4e9-9e059218c4f9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:38.309364 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f07206-bc01-4137-b4e9-9e059218c4f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:38.327331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-b7f07206-bc01-4137-b4e9-9e059218c4f9 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:38.328583 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-b7f07206-bc01-4137-b4e9-9e059218c4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:38.336576 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 518/1041] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 08:02:38 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:38.492382 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695af52-c4d5-4b01-ae8e-de7ed6e929fe None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:38.507007 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2695af52-c4d5-4b01-ae8e-de7ed6e929fe None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:38.512693 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d308fd-3470-439c-a79a-296594997eee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:38.513352 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d308fd-3470-439c-a79a-296594997eee service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:38.513627 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d308fd-3470-439c-a79a-296594997eee service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:38.513909 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d308fd-3470-439c-a79a-296594997eee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:38.524036 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d308fd-3470-439c-a79a-296594997eee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:38.525686 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d308fd-3470-439c-a79a-296594997eee service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:38.536731 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 524/1042] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:38 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:39.474434 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d212659-f1b9-4bb8-853d-69f5520a1a1b None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:39.475006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d212659-f1b9-4bb8-853d-69f5520a1a1b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:39.475006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d212659-f1b9-4bb8-853d-69f5520a1a1b None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:39.476383 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 519/1043] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 08:02:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:39.481348 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e8a27-6878-4e38-bd11-ef459fbdc8bd None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:39.481757 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e8a27-6878-4e38-bd11-ef459fbdc8bd None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:39.481911 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22e8a27-6878-4e38-bd11-ef459fbdc8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:39.500898 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-a22e8a27-6878-4e38-bd11-ef459fbdc8bd None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:39.502109 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-a22e8a27-6878-4e38-bd11-ef459fbdc8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:39.510015 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 525/1044] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 08:02:39 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:39.664366 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d212659-f1b9-4bb8-853d-69f5520a1a1b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:39.678176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d212659-f1b9-4bb8-853d-69f5520a1a1b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:39.683114 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22f07cd-09af-4c05-ad64-19cd45aef945 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:39.683729 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f07cd-09af-4c05-ad64-19cd45aef945 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:39.684014 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f07cd-09af-4c05-ad64-19cd45aef945 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:39.684329 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22f07cd-09af-4c05-ad64-19cd45aef945 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:39.692812 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f07cd-09af-4c05-ad64-19cd45aef945 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:39.694399 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22f07cd-09af-4c05-ad64-19cd45aef945 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:39.704096 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 520/1045] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:39 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:40.577641 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6e9fd-681c-4056-b575-ab2165a583cd None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:40.578218 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6e9fd-681c-4056-b575-ab2165a583cd None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:40.578218 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc6e9fd-681c-4056-b575-ab2165a583cd None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:40.579726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 526/1046] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 08:02:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:40.585310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319dfb2-a0aa-4353-8d83-5b7a24265cfa None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:40.585804 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319dfb2-a0aa-4353-8d83-5b7a24265cfa None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:40.585915 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b319dfb2-a0aa-4353-8d83-5b7a24265cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:40.604489 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-b319dfb2-a0aa-4353-8d83-5b7a24265cfa None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:40.605798 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-b319dfb2-a0aa-4353-8d83-5b7a24265cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:40.614051 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 521/1047] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 08:02:40 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:40.775631 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6e9fd-681c-4056-b575-ab2165a583cd None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:40.790125 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc6e9fd-681c-4056-b575-ab2165a583cd None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:40.795392 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d268fd0-1840-4475-a012-6443d0157e5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:40.796644 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d268fd0-1840-4475-a012-6443d0157e5d service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:40.796936 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d268fd0-1840-4475-a012-6443d0157e5d service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:40.797220 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d268fd0-1840-4475-a012-6443d0157e5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:40.808227 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d268fd0-1840-4475-a012-6443d0157e5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:40.809929 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d268fd0-1840-4475-a012-6443d0157e5d service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:40.824345 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 527/1048] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:40 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:41.694548 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bd6fb-cfe1-4f2a-b675-7cd7b2cdc82c None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:41.695105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bd6fb-cfe1-4f2a-b675-7cd7b2cdc82c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:41.695105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259bd6fb-cfe1-4f2a-b675-7cd7b2cdc82c None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:41.696561 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 522/1049] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 08:02:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:41.702174 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d56d2-cbc4-41eb-b714-64c56b5f569f None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:41.702683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d56d2-cbc4-41eb-b714-64c56b5f569f None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:41.702800 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d56d2-cbc4-41eb-b714-64c56b5f569f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:41.720814 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-e90d56d2-cbc4-41eb-b714-64c56b5f569f None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:41.722030 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-e90d56d2-cbc4-41eb-b714-64c56b5f569f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:41.729765 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 528/1050] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 08:02:41 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:41.881988 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bd6fb-cfe1-4f2a-b675-7cd7b2cdc82c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:41.896518 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259bd6fb-cfe1-4f2a-b675-7cd7b2cdc82c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:41.901670 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aa2377-d521-44d4-b5c4-774c731a578e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:41.902307 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa2377-d521-44d4-b5c4-774c731a578e service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:41.902591 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa2377-d521-44d4-b5c4-774c731a578e service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:41.902865 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aa2377-d521-44d4-b5c4-774c731a578e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:41.912404 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa2377-d521-44d4-b5c4-774c731a578e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:41.914003 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aa2377-d521-44d4-b5c4-774c731a578e service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:41.924932 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 523/1051] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:41 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:42.819856 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafccc90-cab4-4fa4-bbe5-4d81646477fa None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:42.820429 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafccc90-cab4-4fa4-bbe5-4d81646477fa None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:42.820429 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafccc90-cab4-4fa4-bbe5-4d81646477fa None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:42.822143 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 529/1052] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 08:02:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:42.828361 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e46c4a-96bd-45b0-88da-f77357d744a3 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:42.828868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e46c4a-96bd-45b0-88da-f77357d744a3 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:42.828966 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e46c4a-96bd-45b0-88da-f77357d744a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:42.847593 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-f9e46c4a-96bd-45b0-88da-f77357d744a3 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:42.848857 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-f9e46c4a-96bd-45b0-88da-f77357d744a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:42.856747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 524/1053] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 08:02:42 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:43.012961 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafccc90-cab4-4fa4-bbe5-4d81646477fa None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:43.026995 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafccc90-cab4-4fa4-bbe5-4d81646477fa None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:43.032237 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca411510-db38-4c1d-9d73-00adec1cd260 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:43.032896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411510-db38-4c1d-9d73-00adec1cd260 service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:43.033180 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411510-db38-4c1d-9d73-00adec1cd260 service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:43.033456 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca411510-db38-4c1d-9d73-00adec1cd260 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:43.042376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca411510-db38-4c1d-9d73-00adec1cd260 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:43.043967 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca411510-db38-4c1d-9d73-00adec1cd260 service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:43.054953 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 530/1054] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:43 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 08:02:43.932884 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e564e33-6d84-4c01-9c02-8c8de824c8f5 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:43.933546 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e564e33-6d84-4c01-9c02-8c8de824c8f5 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:43.933546 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e564e33-6d84-4c01-9c02-8c8de824c8f5 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:43.934872 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 525/1055] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 08:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:43.941108 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a2ece-c7c7-486d-8a01-40c962182410 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:43.941692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a2ece-c7c7-486d-8a01-40c962182410 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:43.941891 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a2ece-c7c7-486d-8a01-40c962182410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:43.961561 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-099a2ece-c7c7-486d-8a01-40c962182410 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:43.962822 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-099a2ece-c7c7-486d-8a01-40c962182410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:43.971155 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 531/1056] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 08:02:43 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:44.129945 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e564e33-6d84-4c01-9c02-8c8de824c8f5 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:44.146705 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e564e33-6d84-4c01-9c02-8c8de824c8f5 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:44.151964 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6ef90f-81f5-48ef-88c2-659745990107 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:44.152655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef90f-81f5-48ef-88c2-659745990107 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:44.152944 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef90f-81f5-48ef-88c2-659745990107 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:44.153223 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6ef90f-81f5-48ef-88c2-659745990107 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:44.162396 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ef90f-81f5-48ef-88c2-659745990107 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:44.164015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6ef90f-81f5-48ef-88c2-659745990107 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:44.174219 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 526/1057] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:44 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 08:02:46.340077 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119d4ef-7049-4b34-8765-17bc6d3df51f None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:46.340655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119d4ef-7049-4b34-8765-17bc6d3df51f None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:46.340655 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3119d4ef-7049-4b34-8765-17bc6d3df51f None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:46.341996 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 532/1058] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:02:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:46.348423 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93ff5b-df87-4fc9-8822-f19b709dd4d1 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:46.348884 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93ff5b-df87-4fc9-8822-f19b709dd4d1 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:46.348995 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93ff5b-df87-4fc9-8822-f19b709dd4d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:46.367009 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-9f93ff5b-df87-4fc9-8822-f19b709dd4d1 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:46.368286 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-9f93ff5b-df87-4fc9-8822-f19b709dd4d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:46.376729 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 527/1059] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:02:46 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:46.417593 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119d4ef-7049-4b34-8765-17bc6d3df51f None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:46.428428 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3119d4ef-7049-4b34-8765-17bc6d3df51f None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:46.432261 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77b09a2-a320-4cf3-bad8-106628cb77f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:46.432951 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b09a2-a320-4cf3-bad8-106628cb77f6 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:46.433238 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b09a2-a320-4cf3-bad8-106628cb77f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:46.433520 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77b09a2-a320-4cf3-bad8-106628cb77f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:46.443663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b09a2-a320-4cf3-bad8-106628cb77f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:46.445167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77b09a2-a320-4cf3-bad8-106628cb77f6 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:46.455875 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 533/1060] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:46 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:48.984683 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204647a-8021-41d8-8e35-0829c0cdc7ae None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:48.985231 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204647a-8021-41d8-8e35-0829c0cdc7ae None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:48.985231 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f204647a-8021-41d8-8e35-0829c0cdc7ae None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:48.986565 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 528/1061] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:48.992115 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfdb7b-fbac-4430-94ff-f92a9a0eeedc None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:48.992590 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfdb7b-fbac-4430-94ff-f92a9a0eeedc None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:48.992696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfdb7b-fbac-4430-94ff-f92a9a0eeedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:49.010744 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-78bfdb7b-fbac-4430-94ff-f92a9a0eeedc None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:49.011975 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-78bfdb7b-fbac-4430-94ff-f92a9a0eeedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:49.020091 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 534/1062] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:02:48 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:49.059935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204647a-8021-41d8-8e35-0829c0cdc7ae None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:49.071394 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f204647a-8021-41d8-8e35-0829c0cdc7ae None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:49.074898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912283b2-4cc1-4ce8-83cd-b41293617462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:49.075532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912283b2-4cc1-4ce8-83cd-b41293617462 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:49.075844 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912283b2-4cc1-4ce8-83cd-b41293617462 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:49.076138 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912283b2-4cc1-4ce8-83cd-b41293617462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:49.085780 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912283b2-4cc1-4ce8-83cd-b41293617462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:49.087252 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912283b2-4cc1-4ce8-83cd-b41293617462 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:49.098243 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 529/1063] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:49 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:51.736889 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3b7f-527d-437f-8b75-68828b7829b3 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:51.737443 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3b7f-527d-437f-8b75-68828b7829b3 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:51.737860 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fae3b7f-527d-437f-8b75-68828b7829b3 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:51.740386 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 535/1064] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:02:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:51.746180 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32179585-4a16-41fb-8d89-b4881e235c5b None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:51.746686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32179585-4a16-41fb-8d89-b4881e235c5b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:51.746792 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32179585-4a16-41fb-8d89-b4881e235c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:51.766335 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-32179585-4a16-41fb-8d89-b4881e235c5b None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:51.767567 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-32179585-4a16-41fb-8d89-b4881e235c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:51.775649 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 530/1065] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:02:51 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 08:02:51.816348 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae3b7f-527d-437f-8b75-68828b7829b3 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:51.828399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fae3b7f-527d-437f-8b75-68828b7829b3 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:51.832087 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03643a4e-7510-4b36-9b4b-2736561a3d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:51.832777 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03643a4e-7510-4b36-9b4b-2736561a3d8a service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:51.833086 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03643a4e-7510-4b36-9b4b-2736561a3d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:51.833361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03643a4e-7510-4b36-9b4b-2736561a3d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:51.843976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03643a4e-7510-4b36-9b4b-2736561a3d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:51.845517 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03643a4e-7510-4b36-9b4b-2736561a3d8a service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:51.860725 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 536/1066] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:51 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:02:54.353207 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c63f7-1b0d-4021-9be5-74c64da07758 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:54.353779 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c63f7-1b0d-4021-9be5-74c64da07758 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:54.353779 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3c63f7-1b0d-4021-9be5-74c64da07758 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:54.355348 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 531/1067] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:02:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:54.361649 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f91f1-df1f-429a-a33f-60e61af3acfd None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:54.362194 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f91f1-df1f-429a-a33f-60e61af3acfd None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:54.362323 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882f91f1-df1f-429a-a33f-60e61af3acfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:54.381578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-882f91f1-df1f-429a-a33f-60e61af3acfd None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:54.382856 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-882f91f1-df1f-429a-a33f-60e61af3acfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:54.391854 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 537/1068] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:02:54 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:54.433499 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c63f7-1b0d-4021-9be5-74c64da07758 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:54.445250 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3c63f7-1b0d-4021-9be5-74c64da07758 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:54.449249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038ac4d-aaf5-4039-9bcf-6a18128edb4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:54.449959 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038ac4d-aaf5-4039-9bcf-6a18128edb4e service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:54.450277 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038ac4d-aaf5-4039-9bcf-6a18128edb4e service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:54.450587 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038ac4d-aaf5-4039-9bcf-6a18128edb4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:54.461016 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038ac4d-aaf5-4039-9bcf-6a18128edb4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:54.462482 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038ac4d-aaf5-4039-9bcf-6a18128edb4e service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:54.474006 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 532/1069] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:54 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 08:02:56.979442 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287413f6-2e3b-4c2f-a2ef-d52dea4a6c8d None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:56.979982 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287413f6-2e3b-4c2f-a2ef-d52dea4a6c8d None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:56.980399 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287413f6-2e3b-4c2f-a2ef-d52dea4a6c8d None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:56.983000 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 538/1070] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:02:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:56.989176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17875c-f970-4148-93e1-6e2db1e69232 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:56.989795 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17875c-f970-4148-93e1-6e2db1e69232 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:56.989795 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f17875c-f970-4148-93e1-6e2db1e69232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:57.017262 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-7f17875c-f970-4148-93e1-6e2db1e69232 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:57.019222 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-7f17875c-f970-4148-93e1-6e2db1e69232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:57.033370 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 533/1071] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:02:56 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 08:02:57.075757 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287413f6-2e3b-4c2f-a2ef-d52dea4a6c8d None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:57.087678 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287413f6-2e3b-4c2f-a2ef-d52dea4a6c8d None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:57.091533 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29b31c5-bb66-4dec-9154-5e2fe1968aa4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:57.092239 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b31c5-bb66-4dec-9154-5e2fe1968aa4 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:57.092531 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b31c5-bb66-4dec-9154-5e2fe1968aa4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:57.092812 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29b31c5-bb66-4dec-9154-5e2fe1968aa4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:57.103969 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b31c5-bb66-4dec-9154-5e2fe1968aa4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:57.105790 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29b31c5-bb66-4dec-9154-5e2fe1968aa4 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:57.116482 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 539/1072] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 08:02:59.614137 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1ca2a-80b7-44b2-8c05-22ca3f5fcce6 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:59.615102 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1ca2a-80b7-44b2-8c05-22ca3f5fcce6 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:59.615102 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1ca2a-80b7-44b2-8c05-22ca3f5fcce6 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:59.616094 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 534/1073] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:02:59.622644 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccd2fb-62dc-4319-be80-e384c3874db2 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:59.623806 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccd2fb-62dc-4319-be80-e384c3874db2 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:59.623806 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ccd2fb-62dc-4319-be80-e384c3874db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:59.630465 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=70 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:02:59.644628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-c0ccd2fb-62dc-4319-be80-e384c3874db2 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:02:59.645921 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-c0ccd2fb-62dc-4319-be80-e384c3874db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:02:59.654383 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 540/1074] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:02:59 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:02:59.695738 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1ca2a-80b7-44b2-8c05-22ca3f5fcce6 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:02:59.701523 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=64 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:02:59.708632 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1ca2a-80b7-44b2-8c05-22ca3f5fcce6 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:02:59.712559 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db5ef8a-f48b-48bf-b570-dca7f67f9aef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:02:59.713307 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5ef8a-f48b-48bf-b570-dca7f67f9aef service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:02:59.713687 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5ef8a-f48b-48bf-b570-dca7f67f9aef service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:02:59.714060 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db5ef8a-f48b-48bf-b570-dca7f67f9aef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:02:59.724352 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5ef8a-f48b-48bf-b570-dca7f67f9aef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:02:59.725882 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db5ef8a-f48b-48bf-b570-dca7f67f9aef service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:02:59.736985 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 535/1075] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:02:59 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:03:02.160727 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93804b-f9d3-4ca4-accc-41e5b6355030 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:02.161266 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93804b-f9d3-4ca4-accc-41e5b6355030 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:02.161266 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df93804b-f9d3-4ca4-accc-41e5b6355030 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:02.162579 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 541/1076] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:03:02.168201 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e715e-8af5-40ec-a2d1-fed6fdeb070a None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:02.168655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e715e-8af5-40ec-a2d1-fed6fdeb070a None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:02.168765 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e715e-8af5-40ec-a2d1-fed6fdeb070a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:02.187957 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-d48e715e-8af5-40ec-a2d1-fed6fdeb070a None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:03:02.189209 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-d48e715e-8af5-40ec-a2d1-fed6fdeb070a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:03:02.197736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 536/1077] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:03:02 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:03:02.237990 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93804b-f9d3-4ca4-accc-41e5b6355030 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:03:02.248675 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df93804b-f9d3-4ca4-accc-41e5b6355030 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:03:02.252361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf304f2c-bb89-433a-878b-242aba04af10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:03:02.253027 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf304f2c-bb89-433a-878b-242aba04af10 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:02.253317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf304f2c-bb89-433a-878b-242aba04af10 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:02.253609 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf304f2c-bb89-433a-878b-242aba04af10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:02.263498 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf304f2c-bb89-433a-878b-242aba04af10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:03:02.265353 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf304f2c-bb89-433a-878b-242aba04af10 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:03:02.275293 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 542/1078] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:03:02 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:03:04.647355 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920e9bd-7944-4984-a1b2-d188636c5825 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:04.647892 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920e9bd-7944-4984-a1b2-d188636c5825 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:04.647892 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e920e9bd-7944-4984-a1b2-d188636c5825 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:04.649282 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 537/1079] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:03:04.656188 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8dcf8-b066-4534-80a1-f4383d73ebee None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:04.656787 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8dcf8-b066-4534-80a1-f4383d73ebee None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:04.656787 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8dcf8-b066-4534-80a1-f4383d73ebee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:04.679909 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-d6c8dcf8-b066-4534-80a1-f4383d73ebee None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:03:04.681171 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-d6c8dcf8-b066-4534-80a1-f4383d73ebee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:03:04.689752 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 543/1080] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:03:04 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:03:04.729890 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920e9bd-7944-4984-a1b2-d188636c5825 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:03:04.742735 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e920e9bd-7944-4984-a1b2-d188636c5825 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:03:04.746662 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b078f27-70fb-4904-b6af-2014547a47ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:03:04.747331 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b078f27-70fb-4904-b6af-2014547a47ad service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:04.747615 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b078f27-70fb-4904-b6af-2014547a47ad service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:04.747894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b078f27-70fb-4904-b6af-2014547a47ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:04.758727 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b078f27-70fb-4904-b6af-2014547a47ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:03:04.760217 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b078f27-70fb-4904-b6af-2014547a47ad service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:03:04.770682 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 538/1081] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:03:04 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:03:07.099187 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b7f03-c364-4a13-b54a-6275fd500727 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:07.099729 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b7f03-c364-4a13-b54a-6275fd500727 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:07.099903 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b7f03-c364-4a13-b54a-6275fd500727 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:07.101703 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 544/1082] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:03:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:03:07.109828 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf11d5-e469-4c7e-abb4-158700fe3a3e None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:07.110412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf11d5-e469-4c7e-abb4-158700fe3a3e None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:07.110747 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cf11d5-e469-4c7e-abb4-158700fe3a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:07.132071 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-24cf11d5-e469-4c7e-abb4-158700fe3a3e None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:03:07.133441 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-24cf11d5-e469-4c7e-abb4-158700fe3a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:03:07.141935 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 539/1083] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:03:07 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:03:07.182811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b7f03-c364-4a13-b54a-6275fd500727 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:03:07.194535 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b7f03-c364-4a13-b54a-6275fd500727 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:03:07.198230 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7ad2f-b169-44bb-a169-db5fe7b68df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:03:07.198901 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7ad2f-b169-44bb-a169-db5fe7b68df8 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:07.199185 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7ad2f-b169-44bb-a169-db5fe7b68df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:07.199467 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7ad2f-b169-44bb-a169-db5fe7b68df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:07.209709 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7ad2f-b169-44bb-a169-db5fe7b68df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:03:07.211177 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7ad2f-b169-44bb-a169-db5fe7b68df8 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:03:07.221658 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 545/1084] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:03:07 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:03:09.563556 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec76125-5086-47aa-b18d-14a85a16bfad None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:09.564275 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec76125-5086-47aa-b18d-14a85a16bfad None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:09.564275 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec76125-5086-47aa-b18d-14a85a16bfad None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:09.565456 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 540/1085] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:03:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 08:03:09.571458 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6e303-0d34-457a-9477-57b36d392371 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:09.571955 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6e303-0d34-457a-9477-57b36d392371 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:09.572068 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f6e303-0d34-457a-9477-57b36d392371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:09.590184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-70f6e303-0d34-457a-9477-57b36d392371 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:03:09.591410 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-70f6e303-0d34-457a-9477-57b36d392371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:03:09.600292 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 546/1086] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:03:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:03:09.640318 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec76125-5086-47aa-b18d-14a85a16bfad None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:03:09.651206 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec76125-5086-47aa-b18d-14a85a16bfad None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:03:09.655435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f9bb6f-2c24-4d0c-9ff9-c206c8a3ce11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:03:09.656089 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9bb6f-2c24-4d0c-9ff9-c206c8a3ce11 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:09.656412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9bb6f-2c24-4d0c-9ff9-c206c8a3ce11 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:09.656707 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f9bb6f-2c24-4d0c-9ff9-c206c8a3ce11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:09.672352 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9bb6f-2c24-4d0c-9ff9-c206c8a3ce11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:03:09.673945 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f9bb6f-2c24-4d0c-9ff9-c206c8a3ce11 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:03:09.685019 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 541/1087] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:03:09 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:03:19.584811 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=20 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:03:19.679981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=23 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:03:45.324482 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ef17b-315a-4c6e-ac3e-ea2c62a9683e None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:45.325673 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ef17b-315a-4c6e-ac3e-ea2c62a9683e None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:45.325673 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ef17b-315a-4c6e-ac3e-ea2c62a9683e None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:45.326927 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 547/1088] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:03:45.332030 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600495f7-c103-4e5d-af51-eb64a6996073 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:45.332517 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600495f7-c103-4e5d-af51-eb64a6996073 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:45.332620 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600495f7-c103-4e5d-af51-eb64a6996073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:45.350889 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-600495f7-c103-4e5d-af51-eb64a6996073 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:03:45.352074 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-600495f7-c103-4e5d-af51-eb64a6996073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:03:45.359777 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 542/1089] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:03:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:03:45.408720 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82766399-85cd-4bca-ac85-bf90537b933c None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:45.409018 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82766399-85cd-4bca-ac85-bf90537b933c None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:45.409332 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82766399-85cd-4bca-ac85-bf90537b933c None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:45.410727 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 548/1090] 10.222.0.25 () {54 vars in 962 bytes} [Wed May 25 08:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:03:45.416178 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b0a76-8041-4bd6-8916-41f094bef913 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:45.416476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b0a76-8041-4bd6-8916-41f094bef913 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:45.416755 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50b0a76-8041-4bd6-8916-41f094bef913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:45.434774 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-a50b0a76-8041-4bd6-8916-41f094bef913 None None] MFA Rules not processed for user `6ca17baadab7473c81d80597fc0fa0f2`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:03:45.435984 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a50b0a76-8041-4bd6-8916-41f094bef913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:03:45.443557 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 543/1091] 10.222.0.25 () {58 vars in 1059 bytes} [Wed May 25 08:03:45 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:03:45.451672 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82766399-85cd-4bca-ac85-bf90537b933c None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:03:45.463318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82766399-85cd-4bca-ac85-bf90537b933c None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:03:45.467448 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0179ca5c-db7e-46e7-8035-e0effbe64911 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca17baadab7473c81d80597fc0fa0f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:03:45.468105 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179ca5c-db7e-46e7-8035-e0effbe64911 service glance] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:45.468421 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179ca5c-db7e-46e7-8035-e0effbe64911 service glance] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:45.468697 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0179ca5c-db7e-46e7-8035-e0effbe64911 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:45.478552 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179ca5c-db7e-46e7-8035-e0effbe64911 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:03:45.480014 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0179ca5c-db7e-46e7-8035-e0effbe64911 service glance] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:03:45.490697 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 549/1092] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:03:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:03:47.932756 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6898b-02eb-4796-b044-e60347675f81 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:47.933360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6898b-02eb-4796-b044-e60347675f81 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:47.933680 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f6898b-02eb-4796-b044-e60347675f81 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:47.936363 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 544/1093] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:03:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:03:47.941819 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56000f-9bb2-4326-8ba9-69b1e508beb5 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:47.944227 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56000f-9bb2-4326-8ba9-69b1e508beb5 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:47.944227 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be56000f-9bb2-4326-8ba9-69b1e508beb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:47.961632 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-be56000f-9bb2-4326-8ba9-69b1e508beb5 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:03:47.962862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-be56000f-9bb2-4326-8ba9-69b1e508beb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:03:47.971366 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 550/1094] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:03:47 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:03:47.997076 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6898b-02eb-4796-b044-e60347675f81 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:03:48.009997 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f6898b-02eb-4796-b044-e60347675f81 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:03:48.015624 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e8700-e90c-4421-af99-61deebd7b2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:03:48.016324 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e8700-e90c-4421-af99-61deebd7b2af admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:48.016601 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e8700-e90c-4421-af99-61deebd7b2af admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:48.016879 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e8700-e90c-4421-af99-61deebd7b2af admin admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:48.017611 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e8700-e90c-4421-af99-61deebd7b2af admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:03:48.019467 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-849e8700-e90c-4421-af99-61deebd7b2af admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 08:03:48.019467 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: warnings.warn(msg) May 25 08:03:48.019467 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: May 25 08:03:48.020638 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e8700-e90c-4421-af99-61deebd7b2af admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:03:48.040361 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 545/1095] 10.222.0.25 () {56 vars in 1108 bytes} [Wed May 25 08:03:47 2022] GET /identity/v3/projects => generated 1606 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 08:03:50.351925 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c1511-9a45-4e89-a07e-f754e32727a0 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:50.352499 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c1511-9a45-4e89-a07e-f754e32727a0 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:50.352499 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0c1511-9a45-4e89-a07e-f754e32727a0 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:50.353916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 551/1096] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:03:50.359495 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb9fef-aef7-4472-bec2-4b147649ecb2 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:50.359941 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb9fef-aef7-4472-bec2-4b147649ecb2 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:50.360045 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eb9fef-aef7-4472-bec2-4b147649ecb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:50.378405 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-b3eb9fef-aef7-4472-bec2-4b147649ecb2 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:03:50.379610 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-b3eb9fef-aef7-4472-bec2-4b147649ecb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:03:50.387987 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 546/1097] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:03:50 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:03:50.433102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c1511-9a45-4e89-a07e-f754e32727a0 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:03:50.447011 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0c1511-9a45-4e89-a07e-f754e32727a0 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:03:50.452765 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a4aa56-71d6-42af-9c76-464281ea7c53 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:03:50.453413 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4aa56-71d6-42af-9c76-464281ea7c53 service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:50.453699 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4aa56-71d6-42af-9c76-464281ea7c53 service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:50.454076 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a4aa56-71d6-42af-9c76-464281ea7c53 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:50.462328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4aa56-71d6-42af-9c76-464281ea7c53 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:03:50.463918 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a4aa56-71d6-42af-9c76-464281ea7c53 service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:03:50.474934 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 552/1098] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:03:50 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:03:52.974301 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6d0b3-e75b-4a28-b5ec-a3329505c421 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:52.974828 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6d0b3-e75b-4a28-b5ec-a3329505c421 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:52.974949 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac6d0b3-e75b-4a28-b5ec-a3329505c421 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:52.976254 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 547/1099] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:03:52.981425 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833be6c-0717-4866-9dd9-a570310623e1 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:52.981935 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833be6c-0717-4866-9dd9-a570310623e1 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:52.982030 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8833be6c-0717-4866-9dd9-a570310623e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:52.999709 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-8833be6c-0717-4866-9dd9-a570310623e1 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:03:53.000869 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-8833be6c-0717-4866-9dd9-a570310623e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:03:53.008616 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 553/1100] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:03:52 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:03:53.046998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6d0b3-e75b-4a28-b5ec-a3329505c421 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:03:53.057614 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac6d0b3-e75b-4a28-b5ec-a3329505c421 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:03:53.061529 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf58875-8464-4a36-aa48-9ec8921ef4b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:03:53.062168 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf58875-8464-4a36-aa48-9ec8921ef4b3 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:53.062454 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf58875-8464-4a36-aa48-9ec8921ef4b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:53.062733 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf58875-8464-4a36-aa48-9ec8921ef4b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:53.072019 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf58875-8464-4a36-aa48-9ec8921ef4b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:03:53.073522 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf58875-8464-4a36-aa48-9ec8921ef4b3 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:03:53.083805 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 548/1101] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:03:53 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:03:55.433986 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b824003-c8dc-4b16-95d2-08e05d6580f1 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:55.434526 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b824003-c8dc-4b16-95d2-08e05d6580f1 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:55.434526 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b824003-c8dc-4b16-95d2-08e05d6580f1 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:55.435915 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 554/1102] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:03:55.441211 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495ab5-8dc9-4b1f-a01c-ce29c5728018 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:55.441688 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495ab5-8dc9-4b1f-a01c-ce29c5728018 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:55.441795 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3495ab5-8dc9-4b1f-a01c-ce29c5728018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:55.459612 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-d3495ab5-8dc9-4b1f-a01c-ce29c5728018 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:03:55.460880 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-d3495ab5-8dc9-4b1f-a01c-ce29c5728018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:03:55.469557 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 549/1103] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:03:55 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 08:03:55.509327 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b824003-c8dc-4b16-95d2-08e05d6580f1 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:03:55.522640 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b824003-c8dc-4b16-95d2-08e05d6580f1 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:03:55.530882 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5ea326-6a1d-4829-a3f7-d50be3717c0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:03:55.531275 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ea326-6a1d-4829-a3f7-d50be3717c0a service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:55.531522 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ea326-6a1d-4829-a3f7-d50be3717c0a service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:55.531810 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5ea326-6a1d-4829-a3f7-d50be3717c0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:55.542182 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ea326-6a1d-4829-a3f7-d50be3717c0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:03:55.544801 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5ea326-6a1d-4829-a3f7-d50be3717c0a service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:03:55.556130 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 555/1104] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:03:55 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:03:58.016481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e904f-a042-4532-92c3-932966d3d10c None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:58.017033 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e904f-a042-4532-92c3-932966d3d10c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:58.017033 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e904f-a042-4532-92c3-932966d3d10c None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:58.018462 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 550/1105] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:03:58.023629 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c1100-855c-4fde-8268-674f643a56a4 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:58.024041 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c1100-855c-4fde-8268-674f643a56a4 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:58.024220 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84c1100-855c-4fde-8268-674f643a56a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:58.045906 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-d84c1100-855c-4fde-8268-674f643a56a4 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:03:58.047408 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-d84c1100-855c-4fde-8268-674f643a56a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:03:58.055427 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 556/1106] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:03:58 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:03:58.098184 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e904f-a042-4532-92c3-932966d3d10c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:03:58.109542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e904f-a042-4532-92c3-932966d3d10c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:03:58.113071 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76325ed5-1b91-4ec5-b522-76f08c02a2df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:03:58.113697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76325ed5-1b91-4ec5-b522-76f08c02a2df service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:03:58.113981 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76325ed5-1b91-4ec5-b522-76f08c02a2df service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:03:58.114260 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76325ed5-1b91-4ec5-b522-76f08c02a2df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:03:58.123970 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76325ed5-1b91-4ec5-b522-76f08c02a2df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:03:58.125487 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76325ed5-1b91-4ec5-b522-76f08c02a2df service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:03:58.135118 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 551/1107] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:03:58 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:04:00.671195 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bcbcf-a254-46c9-9ec9-7d7f9ab4e766 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:04:00.671766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bcbcf-a254-46c9-9ec9-7d7f9ab4e766 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:04:00.671766 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bcbcf-a254-46c9-9ec9-7d7f9ab4e766 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:04:00.673148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 557/1108] 10.222.0.25 () {54 vars in 926 bytes} [Wed May 25 08:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:04:00.678301 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf50b9a-7362-4648-bf68-9f3f6a181b91 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:04:00.678766 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf50b9a-7362-4648-bf68-9f3f6a181b91 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:04:00.678989 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf50b9a-7362-4648-bf68-9f3f6a181b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:04:00.697148 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-baf50b9a-7362-4648-bf68-9f3f6a181b91 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:04:00.698353 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-baf50b9a-7362-4648-bf68-9f3f6a181b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:04:00.706718 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 552/1109] 10.222.0.25 () {58 vars in 1023 bytes} [Wed May 25 08:04:00 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:04:00.747907 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bcbcf-a254-46c9-9ec9-7d7f9ab4e766 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:04:00.759160 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bcbcf-a254-46c9-9ec9-7d7f9ab4e766 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:04:00.763696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8952a14e-e3aa-4012-b7f4-e0ed1810db99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:04:00.764635 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952a14e-e3aa-4012-b7f4-e0ed1810db99 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:04:00.764926 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952a14e-e3aa-4012-b7f4-e0ed1810db99 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:04:00.765204 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8952a14e-e3aa-4012-b7f4-e0ed1810db99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:04:00.774692 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952a14e-e3aa-4012-b7f4-e0ed1810db99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:04:00.776197 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8952a14e-e3aa-4012-b7f4-e0ed1810db99 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:04:00.786286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 558/1110] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:04:00 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:04:10.692067 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=33 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:04:10.781710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=33 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:05:44.085710 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efa045-41a8-49e0-9c43-1c098cab5fad None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.086938 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efa045-41a8-49e0-9c43-1c098cab5fad None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.086938 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91efa045-41a8-49e0-9c43-1c098cab5fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.155697 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-91efa045-41a8-49e0-9c43-1c098cab5fad None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:05:44.156909 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-91efa045-41a8-49e0-9c43-1c098cab5fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:05:44.203443 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 553/1111] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:05:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:05:44.213452 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52bf75-a83a-4bd1-89e0-9342c3aab5af None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.214033 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52bf75-a83a-4bd1-89e0-9342c3aab5af None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.214033 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52bf75-a83a-4bd1-89e0-9342c3aab5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.233901 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-0b52bf75-a83a-4bd1-89e0-9342c3aab5af None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:05:44.235133 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-0b52bf75-a83a-4bd1-89e0-9342c3aab5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:05:44.243616 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 559/1112] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:05:44 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:05:44.248369 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efa045-41a8-49e0-9c43-1c098cab5fad None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:05:44.258819 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91efa045-41a8-49e0-9c43-1c098cab5fad None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:05:44.263371 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ef6e8-779d-470f-9fed-5562c43025d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:05:44.264324 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ef6e8-779d-470f-9fed-5562c43025d4 admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.264606 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ef6e8-779d-470f-9fed-5562c43025d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.264882 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1ef6e8-779d-470f-9fed-5562c43025d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.265609 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ef6e8-779d-470f-9fed-5562c43025d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 08:05:44.265917 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ef6e8-779d-470f-9fed-5562c43025d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:05:44.266932 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-0a1ef6e8-779d-470f-9fed-5562c43025d4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 08:05:44.266932 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: warnings.warn(msg) May 25 08:05:44.266932 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: May 25 08:05:44.267823 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1ef6e8-779d-470f-9fed-5562c43025d4 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:05:44.280046 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 554/1113] 10.222.0.25 () {58 vars in 1152 bytes} [Wed May 25 08:05:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 08:05:44.288329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52bf75-a83a-4bd1-89e0-9342c3aab5af None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:05:44.297662 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52bf75-a83a-4bd1-89e0-9342c3aab5af None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:05:44.302187 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e1bfc-5489-401d-8dcb-8c1564b10576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:05:44.302835 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e1bfc-5489-401d-8dcb-8c1564b10576 admin admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.303117 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e1bfc-5489-401d-8dcb-8c1564b10576 admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.303392 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815e1bfc-5489-401d-8dcb-8c1564b10576 admin admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.304089 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e1bfc-5489-401d-8dcb-8c1564b10576 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:05:44.306436 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: WARNING py.warnings [None req-815e1bfc-5489-401d-8dcb-8c1564b10576 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 08:05:44.306436 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: warnings.warn(msg) May 25 08:05:44.306436 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: May 25 08:05:44.307624 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815e1bfc-5489-401d-8dcb-8c1564b10576 admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:05:44.343152 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 560/1114] 10.222.0.25 () {60 vars in 1152 bytes} [Wed May 25 08:05:44 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 08:05:44.347577 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ef6e8-779d-470f-9fed-5562c43025d4 admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:05:44.357674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1ef6e8-779d-470f-9fed-5562c43025d4 admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:05:44.414340 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f50f24-e4ba-402f-9986-b6b5fd5470dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:05:44.414948 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f50f24-e4ba-402f-9986-b6b5fd5470dc admin admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.415233 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f50f24-e4ba-402f-9986-b6b5fd5470dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.415510 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f50f24-e4ba-402f-9986-b6b5fd5470dc admin admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.416254 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f50f24-e4ba-402f-9986-b6b5fd5470dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:05:44.417280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-f2f50f24-e4ba-402f-9986-b6b5fd5470dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 08:05:44.417280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: warnings.warn(msg) May 25 08:05:44.417280 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: May 25 08:05:44.418503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f50f24-e4ba-402f-9986-b6b5fd5470dc admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:05:44.439995 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 555/1115] 10.222.0.25 () {60 vars in 1143 bytes} [Wed May 25 08:05:44 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 08:05:44.444334 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e1bfc-5489-401d-8dcb-8c1564b10576 admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:05:44.455307 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815e1bfc-5489-401d-8dcb-8c1564b10576 admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:05:44.459896 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d40486-35df-4d95-93e0-a4c09abdc592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:05:44.460594 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40486-35df-4d95-93e0-a4c09abdc592 admin admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.460981 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40486-35df-4d95-93e0-a4c09abdc592 admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.461151 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d40486-35df-4d95-93e0-a4c09abdc592 admin admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.461875 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d40486-35df-4d95-93e0-a4c09abdc592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:05:44.462897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: WARNING py.warnings [None req-e5d40486-35df-4d95-93e0-a4c09abdc592 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 08:05:44.462897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: warnings.warn(msg) May 25 08:05:44.462897 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: May 25 08:05:44.463770 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d40486-35df-4d95-93e0-a4c09abdc592 admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:05:44.477152 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 561/1116] 10.222.0.25 () {58 vars in 1121 bytes} [Wed May 25 08:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 08:05:44.481328 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f50f24-e4ba-402f-9986-b6b5fd5470dc admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:05:44.491321 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f50f24-e4ba-402f-9986-b6b5fd5470dc admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:05:44.497176 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2a007-0588-47ff-8773-e71ea38743a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:05:44.497877 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2a007-0588-47ff-8773-e71ea38743a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.498310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2a007-0588-47ff-8773-e71ea38743a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.498612 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2a007-0588-47ff-8773-e71ea38743a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.499361 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2a007-0588-47ff-8773-e71ea38743a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:05:44.500479 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-9cc2a007-0588-47ff-8773-e71ea38743a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 08:05:44.500479 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: warnings.warn(msg) May 25 08:05:44.500479 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: May 25 08:05:44.501423 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc2a007-0588-47ff-8773-e71ea38743a4 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:05:44.515680 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 556/1117] 10.222.0.25 () {58 vars in 1121 bytes} [Wed May 25 08:05:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 08:05:44.519972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d40486-35df-4d95-93e0-a4c09abdc592 admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:05:44.530601 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d40486-35df-4d95-93e0-a4c09abdc592 admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:05:44.535327 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc8966a-1bb2-4799-85d7-ee72ce9a449d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:05:44.536263 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8966a-1bb2-4799-85d7-ee72ce9a449d admin admin] REQUEST_METHOD: `PUT` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.536550 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8966a-1bb2-4799-85d7-ee72ce9a449d admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.536831 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc8966a-1bb2-4799-85d7-ee72ce9a449d admin admin] PATH_INFO: `/v3/projects/1f09055f468b471bb2791cbef1c04adc/users/3b1f7c019a614682b2b7e0e0ea20805b/roles/0e5f3c37f30e45da98262a20b891833d` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.552746 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8966a-1bb2-4799-85d7-ee72ce9a449d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f09055f468b471bb2791cbef1c04adc, user_id=3b1f7c019a614682b2b7e0e0ea20805b, role_id=0e5f3c37f30e45da98262a20b891833d)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:05:44.553792 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: WARNING py.warnings [None req-9fc8966a-1bb2-4799-85d7-ee72ce9a449d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 08:05:44.553792 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: warnings.warn(msg) May 25 08:05:44.553792 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: May 25 08:05:44.556323 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc8966a-1bb2-4799-85d7-ee72ce9a449d admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:05:44.570670 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 562/1118] 10.222.0.25 () {60 vars in 1482 bytes} [Wed May 25 08:05:44 2022] PUT /identity/v3/projects/1f09055f468b471bb2791cbef1c04adc/users/3b1f7c019a614682b2b7e0e0ea20805b/roles/0e5f3c37f30e45da98262a20b891833d => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 08:05:44.581897 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaf500-ac03-4cb8-8d09-5c10214d5695 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.582197 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaf500-ac03-4cb8-8d09-5c10214d5695 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.582472 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaaf500-ac03-4cb8-8d09-5c10214d5695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.609415 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-edaaf500-ac03-4cb8-8d09-5c10214d5695 None None] MFA Rules not processed for user `3b1f7c019a614682b2b7e0e0ea20805b`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:05:44.610836 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-edaaf500-ac03-4cb8-8d09-5c10214d5695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:05:44.643214 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:05:44.676323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 557/1119] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:05:44 2022] POST /identity/v3/auth/tokens => generated 2806 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:05:44.690127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf5cb1-8342-4733-a3cf-5fff7d17a1c2 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.690426 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf5cb1-8342-4733-a3cf-5fff7d17a1c2 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.690709 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bf5cb1-8342-4733-a3cf-5fff7d17a1c2 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.692114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 563/1120] 10.222.0.25 () {54 vars in 963 bytes} [Wed May 25 08:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:05:44.697188 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d141d-b748-497b-a6e7-a056768ecacd None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.697477 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d141d-b748-497b-a6e7-a056768ecacd None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.697757 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212d141d-b748-497b-a6e7-a056768ecacd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.725038 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-212d141d-b748-497b-a6e7-a056768ecacd None None] MFA Rules not processed for user `051dfda2a77e4648ae1f5ee47296499d`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:05:44.726344 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-212d141d-b748-497b-a6e7-a056768ecacd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:05:44.794345 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 558/1121] 10.222.0.25 () {58 vars in 1060 bytes} [Wed May 25 08:05:44 2022] POST /identity/v3/auth/tokens => generated 2670 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:05:44.802019 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf5cb1-8342-4733-a3cf-5fff7d17a1c2 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:05:44.813800 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bf5cb1-8342-4733-a3cf-5fff7d17a1c2 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:05:44.817448 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a2ed1-30ac-49a4-9fe9-98d513b0c0c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051dfda2a77e4648ae1f5ee47296499d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:05:44.818123 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a2ed1-30ac-49a4-9fe9-98d513b0c0c0 service cinder] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.818411 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a2ed1-30ac-49a4-9fe9-98d513b0c0c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.818691 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2a2ed1-30ac-49a4-9fe9-98d513b0c0c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.828231 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a2ed1-30ac-49a4-9fe9-98d513b0c0c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:05:44.829707 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2a2ed1-30ac-49a4-9fe9-98d513b0c0c0 service cinder] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:05:44.840190 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 564/1122] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:05:44 2022] GET /identity/v3/auth/tokens => generated 2806 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:05:44.877789 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30113078-1a61-4555-b2c6-6c3940f94bd9 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.878083 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30113078-1a61-4555-b2c6-6c3940f94bd9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.878365 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30113078-1a61-4555-b2c6-6c3940f94bd9 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.879696 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 559/1123] 10.222.0.25 () {52 vars in 829 bytes} [Wed May 25 08:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:05:44.883648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a2ed1-30ac-49a4-9fe9-98d513b0c0c0 service cinder] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:05:44.951043 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2a2ed1-30ac-49a4-9fe9-98d513b0c0c0 service cinder] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:05:44.955671 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:05:44.956577 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:44.956858 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:44.957131 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] PATH_INFO: `/v3/users/3b1f7c019a614682b2b7e0e0ea20805b` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:44.958353 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b1f7c019a614682b2b7e0e0ea20805b)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:05:44.959388 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: WARNING py.warnings [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 08:05:44.959388 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: warnings.warn(msg) May 25 08:05:44.959388 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: May 25 08:05:44.961330 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:05:45.031803 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b1f7c019a614682b2b7e0e0ea20805b'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:05:45.032644 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b1f7c019a614682b2b7e0e0ea20805b'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:05:45.046422 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b1f7c019a614682b2b7e0e0ea20805b'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:05:45.064569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b1f7c019a614682b2b7e0e0ea20805b'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:05:45.065318 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b1f7c019a614682b2b7e0e0ea20805b'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:05:45.069328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:05:45.081157 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 565/1124] 10.222.0.25 () {58 vars in 1223 bytes} [Wed May 25 08:05:44 2022] DELETE /identity/v3/users/3b1f7c019a614682b2b7e0e0ea20805b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 08:05:45.085657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e719a-c62c-482e-99df-0b314390c679 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:45.086546 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e719a-c62c-482e-99df-0b314390c679 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:45.087092 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949e719a-c62c-482e-99df-0b314390c679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:45.105115 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-949e719a-c62c-482e-99df-0b314390c679 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:05:45.106322 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-949e719a-c62c-482e-99df-0b314390c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:05:45.165612 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 560/1125] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:05:45 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 08:05:45.174993 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:05:45.176472 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:05:45.240355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e9d64-d8ee-44a2-9fc6-58774f31b20e admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:05:45.243847 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0952c392-b8f1-4831-841a-b4dc95eea90a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:05:45.244529 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952c392-b8f1-4831-841a-b4dc95eea90a service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:45.244813 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952c392-b8f1-4831-841a-b4dc95eea90a service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:45.245089 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0952c392-b8f1-4831-841a-b4dc95eea90a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:45.254093 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952c392-b8f1-4831-841a-b4dc95eea90a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:05:45.255558 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0952c392-b8f1-4831-841a-b4dc95eea90a service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:05:45.266083 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 566/1126] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:05:45 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:05:45.615079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e719a-c62c-482e-99df-0b314390c679 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:05:45.616797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-949e719a-c62c-482e-99df-0b314390c679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:05:45.630079 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949e719a-c62c-482e-99df-0b314390c679 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:05:45.635655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a54ede-b059-41f7-b5e9-7c5296529d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:05:45.636581 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54ede-b059-41f7-b5e9-7c5296529d9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:05:45.636864 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54ede-b059-41f7-b5e9-7c5296529d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:05:45.637146 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a54ede-b059-41f7-b5e9-7c5296529d9b admin admin] PATH_INFO: `/v3/projects/1f09055f468b471bb2791cbef1c04adc` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:05:45.638396 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a54ede-b059-41f7-b5e9-7c5296529d9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f09055f468b471bb2791cbef1c04adc)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:05:45.639726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-e1a54ede-b059-41f7-b5e9-7c5296529d9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 08:05:45.639726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: warnings.warn(msg) May 25 08:05:45.639726 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: May 25 08:05:45.640960 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a54ede-b059-41f7-b5e9-7c5296529d9b admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:05:45.703046 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-e1a54ede-b059-41f7-b5e9-7c5296529d9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f09055f468b471bb2791cbef1c04adc', 'request_id': 'req-e1a54ede-b059-41f7-b5e9-7c5296529d9b'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:05:45.718274 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-e1a54ede-b059-41f7-b5e9-7c5296529d9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f09055f468b471bb2791cbef1c04adc', 'request_id': 'req-e1a54ede-b059-41f7-b5e9-7c5296529d9b'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:05:45.719520 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:05:45.726428 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-e1a54ede-b059-41f7-b5e9-7c5296529d9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f09055f468b471bb2791cbef1c04adc', 'request_id': 'req-e1a54ede-b059-41f7-b5e9-7c5296529d9b'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:05:45.741614 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-e1a54ede-b059-41f7-b5e9-7c5296529d9b admin admin] The token cache is being invalidate because project 1f09055f468b471bb2791cbef1c04adc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 08:05:45.741826 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-e1a54ede-b059-41f7-b5e9-7c5296529d9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:05:45.742502 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-e1a54ede-b059-41f7-b5e9-7c5296529d9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:05:45.744128 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 561/1127] 10.222.0.25 () {58 vars in 1232 bytes} [Wed May 25 08:05:45 2022] DELETE /identity/v3/projects/1f09055f468b471bb2791cbef1c04adc => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 08:05:55.261555 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:05:55.738534 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:DELETE=3,keystone:SELECT=4,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:07:08.668587 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a651fc-6325-46ca-aaec-232c6217b023 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:08.669168 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a651fc-6325-46ca-aaec-232c6217b023 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:08.669168 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a651fc-6325-46ca-aaec-232c6217b023 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:08.670503 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 567/1128] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 08:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:07:08.675358 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317383d-1585-4446-a0d3-d4a7fd5fa812 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:08.675813 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317383d-1585-4446-a0d3-d4a7fd5fa812 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:08.675918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5317383d-1585-4446-a0d3-d4a7fd5fa812 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:08.694358 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-5317383d-1585-4446-a0d3-d4a7fd5fa812 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:07:08.695590 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-5317383d-1585-4446-a0d3-d4a7fd5fa812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:08.752759 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 562/1129] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 08:07:08 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:07:08.927072 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a651fc-6325-46ca-aaec-232c6217b023 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:07:08.928830 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-88a651fc-6325-46ca-aaec-232c6217b023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:08.997286 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a651fc-6325-46ca-aaec-232c6217b023 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:07:09.002261 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939f7679-076f-45c7-b6b7-42dd4713d93e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:07:09.002906 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f7679-076f-45c7-b6b7-42dd4713d93e service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:09.003192 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f7679-076f-45c7-b6b7-42dd4713d93e service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:09.003470 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939f7679-076f-45c7-b6b7-42dd4713d93e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:09.012272 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f7679-076f-45c7-b6b7-42dd4713d93e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:07:09.014118 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939f7679-076f-45c7-b6b7-42dd4713d93e service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:07:09.023448 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 568/1130] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:07:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:07:09.918387 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c108-79bc-47c7-b969-94808019d5bb None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:09.918932 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c108-79bc-47c7-b969-94808019d5bb None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:09.918932 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4c108-79bc-47c7-b969-94808019d5bb None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:09.920372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 563/1131] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 08:07:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:07:09.925476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52c043-9200-4488-98f6-93d5abf491af None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:09.925922 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52c043-9200-4488-98f6-93d5abf491af None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:09.926039 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52c043-9200-4488-98f6-93d5abf491af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:09.951253 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-0b52c043-9200-4488-98f6-93d5abf491af None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:07:09.952515 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-0b52c043-9200-4488-98f6-93d5abf491af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:09.960569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 569/1132] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 08:07:09 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:07:10.115057 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4c108-79bc-47c7-b969-94808019d5bb None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:07:10.128422 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4c108-79bc-47c7-b969-94808019d5bb None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:07:10.133248 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51d8d71-85c7-4776-aa70-474fab67bc5b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:07:10.133874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d8d71-85c7-4776-aa70-474fab67bc5b service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:10.134159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d8d71-85c7-4776-aa70-474fab67bc5b service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:10.134437 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51d8d71-85c7-4776-aa70-474fab67bc5b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:10.143219 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d8d71-85c7-4776-aa70-474fab67bc5b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:07:10.144865 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51d8d71-85c7-4776-aa70-474fab67bc5b service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:07:10.154227 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 564/1133] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:07:10 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:07:14.971193 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a74e42-e8c0-4dfc-aab4-6de8efceeee8 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:14.971756 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a74e42-e8c0-4dfc-aab4-6de8efceeee8 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:14.971855 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a74e42-e8c0-4dfc-aab4-6de8efceeee8 None None] PATH_INFO: `/v3` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:14.973101 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 570/1134] 10.222.0.57 () {54 vars in 925 bytes} [Wed May 25 08:07:14 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 25 08:07:14.980147 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121881ca-cfb3-4414-b7d2-a1a9da7baf55 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:14.980578 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121881ca-cfb3-4414-b7d2-a1a9da7baf55 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:14.980690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121881ca-cfb3-4414-b7d2-a1a9da7baf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:14.999134 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-121881ca-cfb3-4414-b7d2-a1a9da7baf55 None None] MFA Rules not processed for user `852fb6ed2a764a7db2c2497980c2e06f`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:07:15.000385 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-121881ca-cfb3-4414-b7d2-a1a9da7baf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:15.069072 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 565/1135] 10.222.0.57 () {58 vars in 1015 bytes} [Wed May 25 08:07:14 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:07:19.449888 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35fea6-fb0d-4928-b1dc-272948fa45e5 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:19.450737 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35fea6-fb0d-4928-b1dc-272948fa45e5 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:19.450899 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a35fea6-fb0d-4928-b1dc-272948fa45e5 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:19.452337 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 571/1136] 10.222.0.25 () {54 vars in 960 bytes} [Wed May 25 08:07:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:07:19.457841 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897124f-d04b-4b0d-8545-f799cf81a740 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:19.458285 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897124f-d04b-4b0d-8545-f799cf81a740 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:19.458392 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8897124f-d04b-4b0d-8545-f799cf81a740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:19.476807 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-8897124f-d04b-4b0d-8545-f799cf81a740 None None] MFA Rules not processed for user `852fb6ed2a764a7db2c2497980c2e06f`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:07:19.477924 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8897124f-d04b-4b0d-8545-f799cf81a740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:19.486330 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 566/1137] 10.222.0.25 () {58 vars in 1057 bytes} [Wed May 25 08:07:19 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:07:19.493509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35fea6-fb0d-4928-b1dc-272948fa45e5 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:07:19.506916 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a35fea6-fb0d-4928-b1dc-272948fa45e5 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:07:19.511902 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7e7bd2-a09a-4b54-afe4-e29811c20f82 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '852fb6ed2a764a7db2c2497980c2e06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:07:19.512572 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e7bd2-a09a-4b54-afe4-e29811c20f82 service placement] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:19.513127 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e7bd2-a09a-4b54-afe4-e29811c20f82 service placement] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:19.513409 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7e7bd2-a09a-4b54-afe4-e29811c20f82 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:19.522264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e7bd2-a09a-4b54-afe4-e29811c20f82 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:07:19.523892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7e7bd2-a09a-4b54-afe4-e29811c20f82 service placement] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:07:19.533932 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 572/1138] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:07:19 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:07:21.439279 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd64621-53ef-4467-898e-c00f38eccecf None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:21.439851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd64621-53ef-4467-898e-c00f38eccecf None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:21.439851 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd64621-53ef-4467-898e-c00f38eccecf None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:21.441258 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 567/1139] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 08:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:07:21.446459 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d49e1-c5ac-45d6-9c0a-3519ba9aca82 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:21.446866 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d49e1-c5ac-45d6-9c0a-3519ba9aca82 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:21.447030 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81d49e1-c5ac-45d6-9c0a-3519ba9aca82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:21.465414 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-a81d49e1-c5ac-45d6-9c0a-3519ba9aca82 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:07:21.466604 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-a81d49e1-c5ac-45d6-9c0a-3519ba9aca82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:21.476099 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 573/1140] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 08:07:21 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:07:21.636457 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd64621-53ef-4467-898e-c00f38eccecf None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:07:21.650516 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd64621-53ef-4467-898e-c00f38eccecf None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:07:21.655374 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdf6d7-976b-498f-a2f2-cb546d6a1dbc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:07:21.655998 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdf6d7-976b-498f-a2f2-cb546d6a1dbc service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:21.656309 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdf6d7-976b-498f-a2f2-cb546d6a1dbc service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:21.656584 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdf6d7-976b-498f-a2f2-cb546d6a1dbc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:21.665165 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdf6d7-976b-498f-a2f2-cb546d6a1dbc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:07:21.666761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdf6d7-976b-498f-a2f2-cb546d6a1dbc service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:07:21.675919 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 568/1141] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:07:21 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:07:22.556082 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edc231-abf0-4c14-bd0d-f45de7929764 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:22.556677 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edc231-abf0-4c14-bd0d-f45de7929764 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:22.556677 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37edc231-abf0-4c14-bd0d-f45de7929764 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:22.558033 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 574/1142] 127.0.0.1 () {54 vars in 901 bytes} [Wed May 25 08:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:07:22.562947 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88e9db-d763-4307-89fc-61130f74ea9b None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:22.563374 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88e9db-d763-4307-89fc-61130f74ea9b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:22.563629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88e9db-d763-4307-89fc-61130f74ea9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:22.582110 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-5d88e9db-d763-4307-89fc-61130f74ea9b None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:07:22.583311 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-5d88e9db-d763-4307-89fc-61130f74ea9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:22.591073 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 569/1143] 127.0.0.1 () {58 vars in 998 bytes} [Wed May 25 08:07:22 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:07:22.743828 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edc231-abf0-4c14-bd0d-f45de7929764 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:07:22.757417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37edc231-abf0-4c14-bd0d-f45de7929764 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:07:22.762948 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f369a-6977-4b96-b8db-fea3c82c1c6d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:07:22.763638 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f369a-6977-4b96-b8db-fea3c82c1c6d service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:22.763964 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f369a-6977-4b96-b8db-fea3c82c1c6d service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:22.764288 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f369a-6977-4b96-b8db-fea3c82c1c6d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:22.772803 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f369a-6977-4b96-b8db-fea3c82c1c6d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:07:22.774397 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f369a-6977-4b96-b8db-fea3c82c1c6d service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:07:22.783884 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 575/1144] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:07:22 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:07:26.915479 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48684d0-a5f9-4c98-8ce1-e05657b2dad5 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:26.916002 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48684d0-a5f9-4c98-8ce1-e05657b2dad5 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:26.916150 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48684d0-a5f9-4c98-8ce1-e05657b2dad5 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:26.917429 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 570/1145] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:07:26.923091 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad24d6a-d740-485f-860a-b10b369c87fc None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:26.923510 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad24d6a-d740-485f-860a-b10b369c87fc None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:26.923705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad24d6a-d740-485f-860a-b10b369c87fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:26.941853 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-bad24d6a-d740-485f-860a-b10b369c87fc None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:07:26.943064 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-bad24d6a-d740-485f-860a-b10b369c87fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:26.950839 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 576/1146] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:07:26 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:07:26.988575 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48684d0-a5f9-4c98-8ce1-e05657b2dad5 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:07:26.990253 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-f48684d0-a5f9-4c98-8ce1-e05657b2dad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:27.053217 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:07:27.059410 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48684d0-a5f9-4c98-8ce1-e05657b2dad5 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:07:27.062956 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761b64db-1206-40a9-8d52-9606b99d1ec4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:07:27.063598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b64db-1206-40a9-8d52-9606b99d1ec4 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:27.063883 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b64db-1206-40a9-8d52-9606b99d1ec4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:27.064192 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b64db-1206-40a9-8d52-9606b99d1ec4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:27.073097 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b64db-1206-40a9-8d52-9606b99d1ec4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:07:27.074578 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761b64db-1206-40a9-8d52-9606b99d1ec4 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:07:27.084352 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 571/1147] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:07:26 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:07:29.325005 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93509df2-7fd5-4986-97f7-ec38e9c54a4d None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:29.325509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93509df2-7fd5-4986-97f7-ec38e9c54a4d None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:29.325509 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93509df2-7fd5-4986-97f7-ec38e9c54a4d None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:29.326881 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 577/1148] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:07:29.332791 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be66fb-242b-458e-a8c5-bdc6e02362bf None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:29.333269 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be66fb-242b-458e-a8c5-bdc6e02362bf None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:29.333366 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2be66fb-242b-458e-a8c5-bdc6e02362bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:29.353562 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-b2be66fb-242b-458e-a8c5-bdc6e02362bf None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:07:29.354778 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-b2be66fb-242b-458e-a8c5-bdc6e02362bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:29.362632 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 572/1149] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:07:29 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:07:29.399600 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93509df2-7fd5-4986-97f7-ec38e9c54a4d None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:07:29.411314 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93509df2-7fd5-4986-97f7-ec38e9c54a4d None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:07:29.414785 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9749bb7d-d053-4f93-8b97-9f554c8dbba9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:07:29.415418 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749bb7d-d053-4f93-8b97-9f554c8dbba9 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:29.415701 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749bb7d-d053-4f93-8b97-9f554c8dbba9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:29.415977 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9749bb7d-d053-4f93-8b97-9f554c8dbba9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:29.425059 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749bb7d-d053-4f93-8b97-9f554c8dbba9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:07:29.426528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9749bb7d-d053-4f93-8b97-9f554c8dbba9 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:07:29.436059 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 578/1150] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:07:29 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:07:33.131333 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc080813-7963-4444-aa49-21184f96a652 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:33.131844 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc080813-7963-4444-aa49-21184f96a652 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:33.131844 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc080813-7963-4444-aa49-21184f96a652 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:33.133265 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 573/1151] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:07:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:07:33.139230 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84ff55-5413-495e-a8ae-4d1575eb738e None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:33.139656 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84ff55-5413-495e-a8ae-4d1575eb738e None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:33.139822 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f84ff55-5413-495e-a8ae-4d1575eb738e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:33.158187 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-9f84ff55-5413-495e-a8ae-4d1575eb738e None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:07:33.159372 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-9f84ff55-5413-495e-a8ae-4d1575eb738e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:33.167901 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 579/1152] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:07:33 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:07:33.444005 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc080813-7963-4444-aa49-21184f96a652 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:07:33.445688 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-cc080813-7963-4444-aa49-21184f96a652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:33.513848 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc080813-7963-4444-aa49-21184f96a652 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:07:33.517425 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c6a330-4d85-4986-8a2a-7784c91f0128 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051dfda2a77e4648ae1f5ee47296499d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:07:33.518062 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6a330-4d85-4986-8a2a-7784c91f0128 service cinder] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:33.518343 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6a330-4d85-4986-8a2a-7784c91f0128 service cinder] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:33.518618 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c6a330-4d85-4986-8a2a-7784c91f0128 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:33.528350 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6a330-4d85-4986-8a2a-7784c91f0128 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:07:33.529797 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c6a330-4d85-4986-8a2a-7784c91f0128 service cinder] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:07:33.539323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 574/1153] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:07:33 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:07:35.819247 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acac2ae-043d-4973-843e-984cc8e875a5 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:35.819797 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acac2ae-043d-4973-843e-984cc8e875a5 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:35.819797 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acac2ae-043d-4973-843e-984cc8e875a5 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:35.821224 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 580/1154] 127.0.0.1 () {54 vars in 916 bytes} [Wed May 25 08:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:07:35.826464 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415e3c-6e5c-4f6e-beac-78b5f1cc9c65 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:35.826898 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415e3c-6e5c-4f6e-beac-78b5f1cc9c65 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:35.827009 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac415e3c-6e5c-4f6e-beac-78b5f1cc9c65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:35.845544 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-ac415e3c-6e5c-4f6e-beac-78b5f1cc9c65 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:07:35.846738 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-ac415e3c-6e5c-4f6e-beac-78b5f1cc9c65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:35.855561 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 575/1155] 127.0.0.1 () {58 vars in 1013 bytes} [Wed May 25 08:07:35 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:07:36.133088 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acac2ae-043d-4973-843e-984cc8e875a5 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:07:36.134753 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-2acac2ae-043d-4973-843e-984cc8e875a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:07:36.142681 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=63 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:07:36.149627 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acac2ae-043d-4973-843e-984cc8e875a5 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:07:36.153102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c3d786-a623-479d-9012-23f05bdafa8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051dfda2a77e4648ae1f5ee47296499d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:07:36.153740 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3d786-a623-479d-9012-23f05bdafa8d service cinder] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:07:36.154023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3d786-a623-479d-9012-23f05bdafa8d service cinder] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:07:36.154298 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c3d786-a623-479d-9012-23f05bdafa8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:07:36.163945 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3d786-a623-479d-9012-23f05bdafa8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:07:36.165420 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c3d786-a623-479d-9012-23f05bdafa8d service cinder] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:07:36.174608 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 581/1156] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:07:36 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:07:45.840757 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=42 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:07:46.170562 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=5 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:08:57.249899 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44315371-5d9f-486c-993d-2b97af4d3e92 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.250506 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af8df5-3041-4036-ae42-05aace31e572 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.250904 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44315371-5d9f-486c-993d-2b97af4d3e92 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.251011 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af8df5-3041-4036-ae42-05aace31e572 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.251099 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44315371-5d9f-486c-993d-2b97af4d3e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.251184 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9af8df5-3041-4036-ae42-05aace31e572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.268569 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-d9af8df5-3041-4036-ae42-05aace31e572 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:08:57.268772 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-44315371-5d9f-486c-993d-2b97af4d3e92 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:08:57.269772 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-d9af8df5-3041-4036-ae42-05aace31e572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:08:57.269901 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-44315371-5d9f-486c-993d-2b97af4d3e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:08:57.277484 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 576/1157] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:08:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:08:57.277837 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 582/1158] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:08:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:08:57.287169 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65164402-7466-46f7-9a48-1e3e2cc87748 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.287360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231476a-dfdb-4fb5-949e-9a71b1f3e90b None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.287476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65164402-7466-46f7-9a48-1e3e2cc87748 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.287574 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231476a-dfdb-4fb5-949e-9a71b1f3e90b None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.287722 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65164402-7466-46f7-9a48-1e3e2cc87748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.287820 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9231476a-dfdb-4fb5-949e-9a71b1f3e90b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.306145 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-65164402-7466-46f7-9a48-1e3e2cc87748 None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:08:57.307344 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-65164402-7466-46f7-9a48-1e3e2cc87748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:08:57.307911 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-9231476a-dfdb-4fb5-949e-9a71b1f3e90b None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:08:57.309125 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-9231476a-dfdb-4fb5-949e-9a71b1f3e90b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:08:57.315432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 583/1159] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:08:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:08:57.318904 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 577/1160] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:08:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:08:57.320519 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65164402-7466-46f7-9a48-1e3e2cc87748 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.323066 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231476a-dfdb-4fb5-949e-9a71b1f3e90b None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.329957 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65164402-7466-46f7-9a48-1e3e2cc87748 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.332429 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9231476a-dfdb-4fb5-949e-9a71b1f3e90b None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.334518 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d453d0-5b64-40fc-8a47-5226b72f577b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.335174 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d453d0-5b64-40fc-8a47-5226b72f577b admin admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.335461 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d453d0-5b64-40fc-8a47-5226b72f577b admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.335744 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d453d0-5b64-40fc-8a47-5226b72f577b admin admin] PATH_INFO: `/v3/domains` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.336510 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d453d0-5b64-40fc-8a47-5226b72f577b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87084) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 08:08:57.336824 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d453d0-5b64-40fc-8a47-5226b72f577b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.337325 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153e542-997f-4b4c-9f6c-16329e9927ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.337845 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: WARNING py.warnings [None req-65d453d0-5b64-40fc-8a47-5226b72f577b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 08:08:57.337845 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: warnings.warn(msg) May 25 08:08:57.337845 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: May 25 08:08:57.338110 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153e542-997f-4b4c-9f6c-16329e9927ef admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.338291 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153e542-997f-4b4c-9f6c-16329e9927ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.338521 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3153e542-997f-4b4c-9f6c-16329e9927ef admin admin] PATH_INFO: `/v3/domains` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.338726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d453d0-5b64-40fc-8a47-5226b72f577b admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.339237 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153e542-997f-4b4c-9f6c-16329e9927ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87085) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 25 08:08:57.339542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153e542-997f-4b4c-9f6c-16329e9927ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.341146 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3153e542-997f-4b4c-9f6c-16329e9927ef admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.351637 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 584/1161] 10.222.0.25 () {58 vars in 1152 bytes} [Wed May 25 08:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 08:08:57.357485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 578/1162] 10.222.0.25 () {58 vars in 1152 bytes} [Wed May 25 08:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 25 08:08:57.360069 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d453d0-5b64-40fc-8a47-5226b72f577b admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.365724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153e542-997f-4b4c-9f6c-16329e9927ef admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.370102 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d453d0-5b64-40fc-8a47-5226b72f577b admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.374648 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729696b-eab1-4526-8bab-29b44dbfce4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.375349 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729696b-eab1-4526-8bab-29b44dbfce4d admin admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.375630 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729696b-eab1-4526-8bab-29b44dbfce4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.375770 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3153e542-997f-4b4c-9f6c-16329e9927ef admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.375928 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e729696b-eab1-4526-8bab-29b44dbfce4d admin admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.376619 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729696b-eab1-4526-8bab-29b44dbfce4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.378546 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e729696b-eab1-4526-8bab-29b44dbfce4d admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.380423 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283be50-87a8-4f24-b7a7-522d7808402a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.381063 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283be50-87a8-4f24-b7a7-522d7808402a admin admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.381349 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283be50-87a8-4f24-b7a7-522d7808402a admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.381728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283be50-87a8-4f24-b7a7-522d7808402a admin admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.382311 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283be50-87a8-4f24-b7a7-522d7808402a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.383436 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-8283be50-87a8-4f24-b7a7-522d7808402a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 08:08:57.383436 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: warnings.warn(msg) May 25 08:08:57.383436 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: May 25 08:08:57.384638 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283be50-87a8-4f24-b7a7-522d7808402a admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.405653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 585/1163] 10.222.0.25 () {60 vars in 1152 bytes} [Wed May 25 08:08:57 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 08:08:57.410451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729696b-eab1-4526-8bab-29b44dbfce4d admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.413962 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 579/1164] 10.222.0.25 () {60 vars in 1152 bytes} [Wed May 25 08:08:57 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 08:08:57.414942 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283be50-87a8-4f24-b7a7-522d7808402a admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.484764 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283be50-87a8-4f24-b7a7-522d7808402a admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.489475 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91de0be-aa46-4822-8a16-2b555bf137ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.490147 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91de0be-aa46-4822-8a16-2b555bf137ac admin admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.490436 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91de0be-aa46-4822-8a16-2b555bf137ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.490725 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91de0be-aa46-4822-8a16-2b555bf137ac admin admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.491425 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91de0be-aa46-4822-8a16-2b555bf137ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.492929 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e729696b-eab1-4526-8bab-29b44dbfce4d admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.493380 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91de0be-aa46-4822-8a16-2b555bf137ac admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.497809 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d4af0-d53c-41ce-97df-ed649bc52560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.498523 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d4af0-d53c-41ce-97df-ed649bc52560 admin admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.498808 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d4af0-d53c-41ce-97df-ed649bc52560 admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.499080 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137d4af0-d53c-41ce-97df-ed649bc52560 admin admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.499857 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d4af0-d53c-41ce-97df-ed649bc52560 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.500985 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: WARNING py.warnings [None req-137d4af0-d53c-41ce-97df-ed649bc52560 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 08:08:57.500985 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: warnings.warn(msg) May 25 08:08:57.500985 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: May 25 08:08:57.502361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137d4af0-d53c-41ce-97df-ed649bc52560 admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.517727 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 580/1165] 10.222.0.25 () {60 vars in 1143 bytes} [Wed May 25 08:08:57 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 08:08:57.518888 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91de0be-aa46-4822-8a16-2b555bf137ac admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.529199 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91de0be-aa46-4822-8a16-2b555bf137ac admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.529639 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 586/1166] 10.222.0.25 () {60 vars in 1143 bytes} [Wed May 25 08:08:57 2022] POST /identity/v3/users => generated 289 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 08:08:57.533752 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d4af0-d53c-41ce-97df-ed649bc52560 admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.534700 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8861f2-065d-4933-b265-049e04536d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.535373 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8861f2-065d-4933-b265-049e04536d9f admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.535669 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8861f2-065d-4933-b265-049e04536d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.535938 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8861f2-065d-4933-b265-049e04536d9f admin admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.536708 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8861f2-065d-4933-b265-049e04536d9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.538310 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8861f2-065d-4933-b265-049e04536d9f admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.543521 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137d4af0-d53c-41ce-97df-ed649bc52560 admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.551920 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 581/1167] 10.222.0.25 () {58 vars in 1121 bytes} [Wed May 25 08:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 08:08:57.552103 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1dd7e-3111-46e8-9db5-08ba6776e54d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.552103 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1dd7e-3111-46e8-9db5-08ba6776e54d admin admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.552103 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1dd7e-3111-46e8-9db5-08ba6776e54d admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.552103 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc1dd7e-3111-46e8-9db5-08ba6776e54d admin admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.552490 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1dd7e-3111-46e8-9db5-08ba6776e54d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.552925 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8861f2-065d-4933-b265-049e04536d9f admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.553222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc1dd7e-3111-46e8-9db5-08ba6776e54d admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.562623 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8861f2-065d-4933-b265-049e04536d9f admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.564047 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 587/1168] 10.222.0.25 () {58 vars in 1121 bytes} [Wed May 25 08:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 08:08:57.568190 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee13421-0f12-4d41-9973-64e21cf43a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.568511 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee13421-0f12-4d41-9973-64e21cf43a2e admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.568802 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee13421-0f12-4d41-9973-64e21cf43a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.569083 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee13421-0f12-4d41-9973-64e21cf43a2e admin admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.569191 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1dd7e-3111-46e8-9db5-08ba6776e54d admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.569811 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee13421-0f12-4d41-9973-64e21cf43a2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.571451 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee13421-0f12-4d41-9973-64e21cf43a2e admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.580023 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc1dd7e-3111-46e8-9db5-08ba6776e54d admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.582803 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 582/1169] 10.222.0.25 () {58 vars in 1121 bytes} [Wed May 25 08:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 08:08:57.585088 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c9cee-7802-44af-8d2d-1feaae374408 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.585755 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9cee-7802-44af-8d2d-1feaae374408 admin admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.586045 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9cee-7802-44af-8d2d-1feaae374408 admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.586323 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c9cee-7802-44af-8d2d-1feaae374408 admin admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.586992 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee13421-0f12-4d41-9973-64e21cf43a2e admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.587110 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c9cee-7802-44af-8d2d-1feaae374408 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.588674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c9cee-7802-44af-8d2d-1feaae374408 admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.597082 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee13421-0f12-4d41-9973-64e21cf43a2e admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.603424 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 588/1170] 10.222.0.25 () {58 vars in 1121 bytes} [Wed May 25 08:08:57 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 25 08:08:57.603581 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b8a170-2b73-4a3f-b5c9-773a536d83bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.603581 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8a170-2b73-4a3f-b5c9-773a536d83bb admin admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.603581 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8a170-2b73-4a3f-b5c9-773a536d83bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.603873 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8a170-2b73-4a3f-b5c9-773a536d83bb admin admin] PATH_INFO: `/v3/projects/0487f430a6974b6f9ba737f3542fc1f0/users/d7722d00511543f89c57fd9bcf82e0b9/roles/0e5f3c37f30e45da98262a20b891833d` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.604489 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c9cee-7802-44af-8d2d-1feaae374408 admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.614268 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c9cee-7802-44af-8d2d-1feaae374408 admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.618240 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8a170-2b73-4a3f-b5c9-773a536d83bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0487f430a6974b6f9ba737f3542fc1f0, user_id=d7722d00511543f89c57fd9bcf82e0b9, role_id=0e5f3c37f30e45da98262a20b891833d)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.618830 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763c0c4d-18c2-4686-b38d-ea552cd4576b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.619466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-f4b8a170-2b73-4a3f-b5c9-773a536d83bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 08:08:57.619466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: warnings.warn(msg) May 25 08:08:57.619466 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: May 25 08:08:57.619707 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c0c4d-18c2-4686-b38d-ea552cd4576b admin admin] REQUEST_METHOD: `PUT` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.619960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c0c4d-18c2-4686-b38d-ea552cd4576b admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.620268 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763c0c4d-18c2-4686-b38d-ea552cd4576b admin admin] PATH_INFO: `/v3/projects/e3d0f983416a4b55bfb63f94fa5a3d38/users/df6b69c051754b5c9f3002336d1f5c24/roles/0e5f3c37f30e45da98262a20b891833d` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.621424 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b8a170-2b73-4a3f-b5c9-773a536d83bb admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.635320 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 583/1171] 10.222.0.25 () {60 vars in 1482 bytes} [Wed May 25 08:08:57 2022] PUT /identity/v3/projects/0487f430a6974b6f9ba737f3542fc1f0/users/d7722d00511543f89c57fd9bcf82e0b9/roles/0e5f3c37f30e45da98262a20b891833d => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 08:08:57.635492 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c0c4d-18c2-4686-b38d-ea552cd4576b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3d0f983416a4b55bfb63f94fa5a3d38, user_id=df6b69c051754b5c9f3002336d1f5c24, role_id=0e5f3c37f30e45da98262a20b891833d)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.638561 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763c0c4d-18c2-4686-b38d-ea552cd4576b admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.641090 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a66d0-33f1-4081-a75f-79bb3b72d0da None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.641496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a66d0-33f1-4081-a75f-79bb3b72d0da None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.641665 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52a66d0-33f1-4081-a75f-79bb3b72d0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.652109 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 589/1172] 10.222.0.25 () {60 vars in 1482 bytes} [Wed May 25 08:08:57 2022] PUT /identity/v3/projects/e3d0f983416a4b55bfb63f94fa5a3d38/users/df6b69c051754b5c9f3002336d1f5c24/roles/0e5f3c37f30e45da98262a20b891833d => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 08:08:57.657974 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87070c7b-1790-47fc-9e28-fb4fe31d7a5d None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.658263 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87070c7b-1790-47fc-9e28-fb4fe31d7a5d None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.658542 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87070c7b-1790-47fc-9e28-fb4fe31d7a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.660199 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-e52a66d0-33f1-4081-a75f-79bb3b72d0da None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:08:57.661407 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e52a66d0-33f1-4081-a75f-79bb3b72d0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:08:57.676290 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-87070c7b-1790-47fc-9e28-fb4fe31d7a5d None None] MFA Rules not processed for user `945bb5172fb64c3a9a54077b32240aed`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:08:57.677479 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-87070c7b-1790-47fc-9e28-fb4fe31d7a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:08:57.710105 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:08:57.723872 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 584/1173] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:08:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 08:08:57.730453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:08:57.733923 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a66d0-33f1-4081-a75f-79bb3b72d0da None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.742775 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 590/1174] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:08:57 2022] POST /identity/v3/auth/tokens => generated 2789 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 08:08:57.752589 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87070c7b-1790-47fc-9e28-fb4fe31d7a5d None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:08:57.792674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52a66d0-33f1-4081-a75f-79bb3b72d0da None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.796323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c7b6e-182b-433d-a034-55261e6bff6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.797012 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7b6e-182b-433d-a034-55261e6bff6d service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.797296 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7b6e-182b-433d-a034-55261e6bff6d service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.797571 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c7b6e-182b-433d-a034-55261e6bff6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.807124 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7b6e-182b-433d-a034-55261e6bff6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.808557 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87070c7b-1790-47fc-9e28-fb4fe31d7a5d None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:08:57.808692 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382c7b6e-182b-433d-a034-55261e6bff6d service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.812193 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244fabb-7666-492c-9bc4-2f8030fe4c79 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:08:57.812840 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244fabb-7666-492c-9bc4-2f8030fe4c79 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:08:57.813124 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244fabb-7666-492c-9bc4-2f8030fe4c79 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:08:57.813395 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244fabb-7666-492c-9bc4-2f8030fe4c79 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:08:57.818152 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 585/1175] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:08:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 08:08:57.822922 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244fabb-7666-492c-9bc4-2f8030fe4c79 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:08:57.824400 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244fabb-7666-492c-9bc4-2f8030fe4c79 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:08:57.834928 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 591/1176] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:08:57 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 08:09:02.527161 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2e9f-e30b-4460-9575-d94b50ac5097 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:02.527761 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2e9f-e30b-4460-9575-d94b50ac5097 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:02.528241 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492c2e9f-e30b-4460-9575-d94b50ac5097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:02.594175 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-492c2e9f-e30b-4460-9575-d94b50ac5097 None None] MFA Rules not processed for user `d7722d00511543f89c57fd9bcf82e0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:02.597410 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-492c2e9f-e30b-4460-9575-d94b50ac5097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:02.763847 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 586/1177] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:09:02 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:02.765056 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244fabb-7666-492c-9bc4-2f8030fe4c79 service neutron] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:02.792892 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244fabb-7666-492c-9bc4-2f8030fe4c79 service neutron] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:02.804063 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbcbd0-b8b9-438f-aa19-cd436a202601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:02.804771 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbcbd0-b8b9-438f-aa19-cd436a202601 admin admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:02.805057 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbcbd0-b8b9-438f-aa19-cd436a202601 admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:02.805330 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bbcbd0-b8b9-438f-aa19-cd436a202601 admin admin] PATH_INFO: `/v3/projects` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:02.807172 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbcbd0-b8b9-438f-aa19-cd436a202601 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:02.809726 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bbcbd0-b8b9-438f-aa19-cd436a202601 admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:02.873486 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c2e9f-e30b-4460-9575-d94b50ac5097 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:02.880317 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 592/1178] 10.222.0.25 () {60 vars in 1152 bytes} [Wed May 25 08:09:02 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 08:09:02.895752 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492c2e9f-e30b-4460-9575-d94b50ac5097 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:03.017372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb73b93-0666-465f-acd6-2ecf9cc10849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:03.018062 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb73b93-0666-465f-acd6-2ecf9cc10849 admin admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:03.018357 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb73b93-0666-465f-acd6-2ecf9cc10849 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:03.018616 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb73b93-0666-465f-acd6-2ecf9cc10849 admin admin] PATH_INFO: `/v3/users` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:03.019333 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb73b93-0666-465f-acd6-2ecf9cc10849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:03.021304 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb73b93-0666-465f-acd6-2ecf9cc10849 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:03.049572 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 587/1179] 10.222.0.25 () {60 vars in 1143 bytes} [Wed May 25 08:09:02 2022] POST /identity/v3/users => generated 299 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 25 08:09:03.053696 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbcbd0-b8b9-438f-aa19-cd436a202601 admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:03.067833 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bbcbd0-b8b9-438f-aa19-cd436a202601 admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:03.080053 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693bbde-552c-41e9-b9eb-e34082a740a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:03.080835 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693bbde-552c-41e9-b9eb-e34082a740a6 admin admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:03.081159 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693bbde-552c-41e9-b9eb-e34082a740a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:03.085384 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5693bbde-552c-41e9-b9eb-e34082a740a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:03.086230 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693bbde-552c-41e9-b9eb-e34082a740a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:03.088058 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5693bbde-552c-41e9-b9eb-e34082a740a6 admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:03.127510 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb73b93-0666-465f-acd6-2ecf9cc10849 admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:03.132996 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 593/1180] 10.222.0.25 () {58 vars in 1121 bytes} [Wed May 25 08:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 08:09:03.147037 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb73b93-0666-465f-acd6-2ecf9cc10849 admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:03.158041 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ad32c-0dd1-4132-a74b-befa04a466a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:03.159186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ad32c-0dd1-4132-a74b-befa04a466a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:03.159477 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ad32c-0dd1-4132-a74b-befa04a466a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:03.159760 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36ad32c-0dd1-4132-a74b-befa04a466a0 admin admin] PATH_INFO: `/v3/projects/8dff53657d084d2e9adcd18355d39731/users/3dad674870854344a961a8f21f6ceaa3/roles/5c1382efdc2e4eebaf5f15a4cdae58e0` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:03.179861 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ad32c-0dd1-4132-a74b-befa04a466a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dff53657d084d2e9adcd18355d39731, user_id=3dad674870854344a961a8f21f6ceaa3, role_id=5c1382efdc2e4eebaf5f15a4cdae58e0)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:03.188462 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36ad32c-0dd1-4132-a74b-befa04a466a0 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:03.191299 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:09:03.221041 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693bbde-552c-41e9-b9eb-e34082a740a6 admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:03.221992 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 588/1181] 10.222.0.25 () {60 vars in 1482 bytes} [Wed May 25 08:09:03 2022] PUT /identity/v3/projects/8dff53657d084d2e9adcd18355d39731/users/3dad674870854344a961a8f21f6ceaa3/roles/5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 08:09:03.235387 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5693bbde-552c-41e9-b9eb-e34082a740a6 admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:03.340683 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac09c493-ebb6-408d-8d18-485837a1397d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:03.341722 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09c493-ebb6-408d-8d18-485837a1397d admin admin] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:03.342209 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09c493-ebb6-408d-8d18-485837a1397d admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:03.342860 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac09c493-ebb6-408d-8d18-485837a1397d admin admin] PATH_INFO: `/v3/roles` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:03.343847 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09c493-ebb6-408d-8d18-485837a1397d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:03.345771 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac09c493-ebb6-408d-8d18-485837a1397d admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:03.361502 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 594/1182] 10.222.0.25 () {58 vars in 1121 bytes} [Wed May 25 08:09:03 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 08:09:03.365966 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ad32c-0dd1-4132-a74b-befa04a466a0 admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:03.383041 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36ad32c-0dd1-4132-a74b-befa04a466a0 admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:03.388475 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a443-3057-4eea-8d00-6abb8ffa22bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:03.389388 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a443-3057-4eea-8d00-6abb8ffa22bb admin admin] REQUEST_METHOD: `PUT` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:03.389671 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a443-3057-4eea-8d00-6abb8ffa22bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:03.389954 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5a443-3057-4eea-8d00-6abb8ffa22bb admin admin] PATH_INFO: `/v3/projects/8dff53657d084d2e9adcd18355d39731/users/3dad674870854344a961a8f21f6ceaa3/roles/5c1382efdc2e4eebaf5f15a4cdae58e0` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:03.393137 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5a443-3057-4eea-8d00-6abb8ffa22bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dff53657d084d2e9adcd18355d39731, user_id=3dad674870854344a961a8f21f6ceaa3, role_id=5c1382efdc2e4eebaf5f15a4cdae58e0)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:03.395878 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5a443-3057-4eea-8d00-6abb8ffa22bb admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:03.414215 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 589/1183] 10.222.0.25 () {60 vars in 1482 bytes} [Wed May 25 08:09:03 2022] PUT /identity/v3/projects/8dff53657d084d2e9adcd18355d39731/users/3dad674870854344a961a8f21f6ceaa3/roles/5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 08:09:03.702207 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112bbd7-a44e-4285-a7c7-d6f8674d9760 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:03.702343 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112bbd7-a44e-4285-a7c7-d6f8674d9760 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:03.702665 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8112bbd7-a44e-4285-a7c7-d6f8674d9760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:03.738989 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-8112bbd7-a44e-4285-a7c7-d6f8674d9760 None None] MFA Rules not processed for user `df6b69c051754b5c9f3002336d1f5c24`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:03.740344 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-8112bbd7-a44e-4285-a7c7-d6f8674d9760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:03.829166 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:09:03.853694 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 595/1184] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:09:03 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:03.858167 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a443-3057-4eea-8d00-6abb8ffa22bb admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:03.976615 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5a443-3057-4eea-8d00-6abb8ffa22bb admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:03.982751 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e5e3e-6c78-4319-b3dc-885207430978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:03.983532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e5e3e-6c78-4319-b3dc-885207430978 admin admin] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:03.984563 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e5e3e-6c78-4319-b3dc-885207430978 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:03.984971 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197e5e3e-6c78-4319-b3dc-885207430978 admin admin] PATH_INFO: `/v3/projects` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:03.985765 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e5e3e-6c78-4319-b3dc-885207430978 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:03.989534 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197e5e3e-6c78-4319-b3dc-885207430978 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:04.032507 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 590/1185] 10.222.0.25 () {60 vars in 1152 bytes} [Wed May 25 08:09:03 2022] POST /identity/v3/projects => generated 379 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 08:09:04.037444 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112bbd7-a44e-4285-a7c7-d6f8674d9760 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:04.049322 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8112bbd7-a44e-4285-a7c7-d6f8674d9760 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:04.132376 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c47c21-deee-46c8-b9c8-5abd70286d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:04.133004 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c47c21-deee-46c8-b9c8-5abd70286d14 admin admin] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:04.133274 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c47c21-deee-46c8-b9c8-5abd70286d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:04.133553 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c47c21-deee-46c8-b9c8-5abd70286d14 admin admin] PATH_INFO: `/v3/users` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:04.134262 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c47c21-deee-46c8-b9c8-5abd70286d14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:04.136226 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c47c21-deee-46c8-b9c8-5abd70286d14 admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:04.164187 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 596/1186] 10.222.0.25 () {60 vars in 1143 bytes} [Wed May 25 08:09:04 2022] POST /identity/v3/users => generated 296 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 25 08:09:04.167011 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e5e3e-6c78-4319-b3dc-885207430978 admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:04.183839 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197e5e3e-6c78-4319-b3dc-885207430978 admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:04.195601 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef741e-508d-4006-baed-0a4ed348340a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:04.196631 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef741e-508d-4006-baed-0a4ed348340a admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:04.197034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef741e-508d-4006-baed-0a4ed348340a admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:04.197385 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feef741e-508d-4006-baed-0a4ed348340a admin admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:04.198462 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef741e-508d-4006-baed-0a4ed348340a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:04.200691 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feef741e-508d-4006-baed-0a4ed348340a admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:04.216172 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 591/1187] 10.222.0.25 () {58 vars in 1121 bytes} [Wed May 25 08:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 08:09:04.219826 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c47c21-deee-46c8-b9c8-5abd70286d14 admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:04.237808 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c47c21-deee-46c8-b9c8-5abd70286d14 admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:04.262134 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377163d-77cb-42ba-9c3e-2722c374d14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:04.263055 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377163d-77cb-42ba-9c3e-2722c374d14d admin admin] REQUEST_METHOD: `PUT` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:04.263363 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377163d-77cb-42ba-9c3e-2722c374d14d admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:04.263669 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377163d-77cb-42ba-9c3e-2722c374d14d admin admin] PATH_INFO: `/v3/projects/082af09e48744103b3650c73ad86d8e1/users/fa30cf710be94787a4a5e5212205ad68/roles/5c1382efdc2e4eebaf5f15a4cdae58e0` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:04.299927 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377163d-77cb-42ba-9c3e-2722c374d14d admin admin] RBAC: Authorizing `identity:create_grant(project_id=082af09e48744103b3650c73ad86d8e1, user_id=fa30cf710be94787a4a5e5212205ad68, role_id=5c1382efdc2e4eebaf5f15a4cdae58e0)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:04.302628 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377163d-77cb-42ba-9c3e-2722c374d14d admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:04.331264 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 597/1188] 10.222.0.25 () {60 vars in 1482 bytes} [Wed May 25 08:09:04 2022] PUT /identity/v3/projects/082af09e48744103b3650c73ad86d8e1/users/fa30cf710be94787a4a5e5212205ad68/roles/5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 08:09:04.337011 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef741e-508d-4006-baed-0a4ed348340a admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:04.371585 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feef741e-508d-4006-baed-0a4ed348340a admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:04.507360 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5448322f-ec5b-4c32-aeeb-36a494903905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:04.508394 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448322f-ec5b-4c32-aeeb-36a494903905 admin admin] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:04.508728 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448322f-ec5b-4c32-aeeb-36a494903905 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:04.509250 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5448322f-ec5b-4c32-aeeb-36a494903905 admin admin] PATH_INFO: `/v3/roles` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:04.510549 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448322f-ec5b-4c32-aeeb-36a494903905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:04.514135 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5448322f-ec5b-4c32-aeeb-36a494903905 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:04.527060 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 592/1189] 10.222.0.25 () {58 vars in 1121 bytes} [Wed May 25 08:09:04 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 25 08:09:04.532515 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377163d-77cb-42ba-9c3e-2722c374d14d admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:04.547307 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377163d-77cb-42ba-9c3e-2722c374d14d admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:04.560739 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e3ea5-5b49-4092-9022-e27a622e29d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:04.561829 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e3ea5-5b49-4092-9022-e27a622e29d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:04.562235 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e3ea5-5b49-4092-9022-e27a622e29d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:04.562585 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867e3ea5-5b49-4092-9022-e27a622e29d4 admin admin] PATH_INFO: `/v3/projects/082af09e48744103b3650c73ad86d8e1/users/fa30cf710be94787a4a5e5212205ad68/roles/5c1382efdc2e4eebaf5f15a4cdae58e0` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:04.564822 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e3ea5-5b49-4092-9022-e27a622e29d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=082af09e48744103b3650c73ad86d8e1, user_id=fa30cf710be94787a4a5e5212205ad68, role_id=5c1382efdc2e4eebaf5f15a4cdae58e0)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:04.568074 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867e3ea5-5b49-4092-9022-e27a622e29d4 admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:04.581834 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 598/1190] 10.222.0.25 () {60 vars in 1482 bytes} [Wed May 25 08:09:04 2022] PUT /identity/v3/projects/082af09e48744103b3650c73ad86d8e1/users/fa30cf710be94787a4a5e5212205ad68/roles/5c1382efdc2e4eebaf5f15a4cdae58e0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 08:09:10.354024 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfcbf6-dfec-4cf1-9ccf-2426a18fbab3 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:10.354601 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfcbf6-dfec-4cf1-9ccf-2426a18fbab3 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:10.354601 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bfcbf6-dfec-4cf1-9ccf-2426a18fbab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:10.386117 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-21bfcbf6-dfec-4cf1-9ccf-2426a18fbab3 None None] MFA Rules not processed for user `3dad674870854344a961a8f21f6ceaa3`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:10.387848 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-21bfcbf6-dfec-4cf1-9ccf-2426a18fbab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:10.438628 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:09:10.500373 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 593/1191] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:09:10 2022] POST /identity/v3/auth/tokens => generated 2879 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:10.512910 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e3ea5-5b49-4092-9022-e27a622e29d4 admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:10.514937 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-867e3ea5-5b49-4092-9022-e27a622e29d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:10.629699 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867e3ea5-5b49-4092-9022-e27a622e29d4 admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:10.639476 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2ddfd-b664-465d-8d86-e0b911f85790 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca17baadab7473c81d80597fc0fa0f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:10.641534 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2ddfd-b664-465d-8d86-e0b911f85790 service glance] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:10.642041 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2ddfd-b664-465d-8d86-e0b911f85790 service glance] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:10.642530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb2ddfd-b664-465d-8d86-e0b911f85790 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:10.736810 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:09:10.782402 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2ddfd-b664-465d-8d86-e0b911f85790 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:10.784631 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb2ddfd-b664-465d-8d86-e0b911f85790 service glance] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:10.822259 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 599/1192] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:09:10 2022] GET /identity/v3/auth/tokens => generated 2812 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:09:11.612091 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6362-1abe-4365-a272-740766a54df3 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:11.613186 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6362-1abe-4365-a272-740766a54df3 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:11.613634 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070a6362-1abe-4365-a272-740766a54df3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:11.664711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-070a6362-1abe-4365-a272-740766a54df3 None None] MFA Rules not processed for user `fa30cf710be94787a4a5e5212205ad68`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:11.667993 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-070a6362-1abe-4365-a272-740766a54df3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:11.797959 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 594/1193] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:09:11 2022] POST /identity/v3/auth/tokens => generated 2873 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:11.807302 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2ddfd-b664-465d-8d86-e0b911f85790 service glance] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:11.817136 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb2ddfd-b664-465d-8d86-e0b911f85790 service glance] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:11.822383 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212847f-31f9-4942-ab99-11ab6528e96b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca17baadab7473c81d80597fc0fa0f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:11.822383 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212847f-31f9-4942-ab99-11ab6528e96b service glance] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:11.822383 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212847f-31f9-4942-ab99-11ab6528e96b service glance] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:11.822383 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212847f-31f9-4942-ab99-11ab6528e96b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:11.919238 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212847f-31f9-4942-ab99-11ab6528e96b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:11.921930 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212847f-31f9-4942-ab99-11ab6528e96b service glance] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:11.933871 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 600/1194] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:09:11 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:09:19.533264 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f880c-369e-4b64-a647-afc972719031 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:19.533883 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f880c-369e-4b64-a647-afc972719031 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:19.534073 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f880c-369e-4b64-a647-afc972719031 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:19.564991 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-e52f880c-369e-4b64-a647-afc972719031 None None] MFA Rules not processed for user `d7722d00511543f89c57fd9bcf82e0b9`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:19.565967 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e52f880c-369e-4b64-a647-afc972719031 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:19.574242 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 595/1195] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:09:19 2022] POST /identity/v3/auth/tokens => generated 2812 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:19.912247 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa410f-bac9-4ae5-bb6d-748f4f58a065 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:19.912850 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa410f-bac9-4ae5-bb6d-748f4f58a065 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:19.913077 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaa410f-bac9-4ae5-bb6d-748f4f58a065 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:19.916042 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 601/1196] 10.222.0.25 () {54 vars in 961 bytes} [Wed May 25 08:09:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:09:19.926019 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28de3-4003-425e-b202-15a85f65e445 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:19.926303 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28de3-4003-425e-b202-15a85f65e445 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:19.926576 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb28de3-4003-425e-b202-15a85f65e445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:20.011042 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-2eb28de3-4003-425e-b202-15a85f65e445 None None] MFA Rules not processed for user `0b9bc11432e04e779fffd35473e6fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:20.012823 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-2eb28de3-4003-425e-b202-15a85f65e445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:20.167909 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 596/1197] 10.222.0.25 () {58 vars in 1058 bytes} [Wed May 25 08:09:19 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:20.174256 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effec5e-0ff5-4098-9bf9-f4870423719b None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:20.174966 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effec5e-0ff5-4098-9bf9-f4870423719b None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:20.175515 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4effec5e-0ff5-4098-9bf9-f4870423719b None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:20.177965 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 602/1198] 10.222.0.25 () {54 vars in 912 bytes} [Wed May 25 08:09:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:09:20.185715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6442fa-7b8e-4d35-ab00-2a0448f49d39 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:20.186066 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6442fa-7b8e-4d35-ab00-2a0448f49d39 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:20.187008 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6442fa-7b8e-4d35-ab00-2a0448f49d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:20.209603 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-2f6442fa-7b8e-4d35-ab00-2a0448f49d39 None None] MFA Rules not processed for user `0b9bc11432e04e779fffd35473e6fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:20.211389 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-2f6442fa-7b8e-4d35-ab00-2a0448f49d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:20.238485 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 597/1199] 10.222.0.25 () {58 vars in 1009 bytes} [Wed May 25 08:09:20 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:20.256885 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effec5e-0ff5-4098-9bf9-f4870423719b None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:20.259067 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-4effec5e-0ff5-4098-9bf9-f4870423719b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:20.295042 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4effec5e-0ff5-4098-9bf9-f4870423719b None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:20.300138 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c0e25-4ca1-4d40-9056-b16d0ae1bea7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6ca17baadab7473c81d80597fc0fa0f2', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:20.301031 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c0e25-4ca1-4d40-9056-b16d0ae1bea7 service glance] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:20.301320 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c0e25-4ca1-4d40-9056-b16d0ae1bea7 service glance] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:20.301603 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c0e25-4ca1-4d40-9056-b16d0ae1bea7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:20.313891 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c0e25-4ca1-4d40-9056-b16d0ae1bea7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:20.316321 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c0e25-4ca1-4d40-9056-b16d0ae1bea7 service glance] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:20.348199 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 603/1200] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:09:20 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:09:20.847165 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d1dc4-42bc-4da4-9a2f-bbf6e5fa72c6 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:20.847608 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d1dc4-42bc-4da4-9a2f-bbf6e5fa72c6 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:20.847608 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67d1dc4-42bc-4da4-9a2f-bbf6e5fa72c6 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:20.849270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 598/1201] 10.222.0.25 () {54 vars in 912 bytes} [Wed May 25 08:09:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:09:20.859469 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2739e-86fc-4109-8926-9f4518d70ffe None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:20.860160 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2739e-86fc-4109-8926-9f4518d70ffe None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:20.860664 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e2739e-86fc-4109-8926-9f4518d70ffe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:20.883721 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-39e2739e-86fc-4109-8926-9f4518d70ffe None None] MFA Rules not processed for user `e0eaeb03cb5f487f9640938b244fe210`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:20.885684 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-39e2739e-86fc-4109-8926-9f4518d70ffe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:21.006668 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 604/1202] 10.222.0.25 () {58 vars in 1009 bytes} [Wed May 25 08:09:20 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:21.022087 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d1dc4-42bc-4da4-9a2f-bbf6e5fa72c6 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:21.024281 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a67d1dc4-42bc-4da4-9a2f-bbf6e5fa72c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:21.049071 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67d1dc4-42bc-4da4-9a2f-bbf6e5fa72c6 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:21.054172 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69b364-0df2-433f-8c60-5dbdec811612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:21.054815 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69b364-0df2-433f-8c60-5dbdec811612 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:21.055103 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69b364-0df2-433f-8c60-5dbdec811612 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:21.055476 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69b364-0df2-433f-8c60-5dbdec811612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:21.063974 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69b364-0df2-433f-8c60-5dbdec811612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:21.065540 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69b364-0df2-433f-8c60-5dbdec811612 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:21.098843 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 599/1203] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:09:21 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:09:21.627889 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578f167-7292-42ed-87c8-ac09d0659458 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:21.628808 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578f167-7292-42ed-87c8-ac09d0659458 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:21.629178 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a578f167-7292-42ed-87c8-ac09d0659458 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:21.635148 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 605/1204] 10.222.0.25 () {54 vars in 961 bytes} [Wed May 25 08:09:21 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:09:21.641459 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb432e-1399-4c8b-aa3d-75a3fbc147b6 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:21.641965 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb432e-1399-4c8b-aa3d-75a3fbc147b6 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:21.642322 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb432e-1399-4c8b-aa3d-75a3fbc147b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:21.678624 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-cdcb432e-1399-4c8b-aa3d-75a3fbc147b6 None None] MFA Rules not processed for user `0b9bc11432e04e779fffd35473e6fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:21.681075 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca0819-e42d-42ed-81d9-5a6feaaf6c20 None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:21.681451 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca0819-e42d-42ed-81d9-5a6feaaf6c20 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:21.681807 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adca0819-e42d-42ed-81d9-5a6feaaf6c20 None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:21.683499 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 606/1205] 10.222.0.25 () {54 vars in 960 bytes} [Wed May 25 08:09:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 25 08:09:21.684316 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-cdcb432e-1399-4c8b-aa3d-75a3fbc147b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:21.689201 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88b9f-5112-42b3-b287-97ac8439c293 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:21.689567 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88b9f-5112-42b3-b287-97ac8439c293 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:21.689924 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f88b9f-5112-42b3-b287-97ac8439c293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:21.711120 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 600/1206] 10.222.0.25 () {58 vars in 1058 bytes} [Wed May 25 08:09:21 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:21.719151 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267a05f-c63f-4304-b63d-754d5e9a47bb None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:21.719444 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267a05f-c63f-4304-b63d-754d5e9a47bb None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:21.719872 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267a05f-c63f-4304-b63d-754d5e9a47bb None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:21.721711 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 601/1207] 10.222.0.25 () {54 vars in 912 bytes} [Wed May 25 08:09:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:09:21.726833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07468dee-4f7a-424f-aacf-e43b15372526 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:21.728630 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07468dee-4f7a-424f-aacf-e43b15372526 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:21.729028 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07468dee-4f7a-424f-aacf-e43b15372526 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:21.737370 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-70f88b9f-5112-42b3-b287-97ac8439c293 None None] MFA Rules not processed for user `852fb6ed2a764a7db2c2497980c2e06f`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:21.739300 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-70f88b9f-5112-42b3-b287-97ac8439c293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:21.771496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-07468dee-4f7a-424f-aacf-e43b15372526 None None] MFA Rules not processed for user `0b9bc11432e04e779fffd35473e6fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:21.778512 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-07468dee-4f7a-424f-aacf-e43b15372526 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:21.799681 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 602/1208] 10.222.0.25 () {58 vars in 1009 bytes} [Wed May 25 08:09:21 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:21.812048 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07468dee-4f7a-424f-aacf-e43b15372526 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:21.822999 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07468dee-4f7a-424f-aacf-e43b15372526 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:21.826690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00256de4-cfe1-4167-8d4a-521fdb08a0be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:21.827399 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00256de4-cfe1-4167-8d4a-521fdb08a0be service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:21.827680 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00256de4-cfe1-4167-8d4a-521fdb08a0be service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:21.827950 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00256de4-cfe1-4167-8d4a-521fdb08a0be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:21.837109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=100 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:09:21.843468 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00256de4-cfe1-4167-8d4a-521fdb08a0be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:21.845739 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00256de4-cfe1-4167-8d4a-521fdb08a0be service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:21.859133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 603/1209] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:09:21 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 25 08:09:21.860891 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 607/1210] 10.222.0.25 () {58 vars in 1057 bytes} [Wed May 25 08:09:21 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:21.870225 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00256de4-cfe1-4167-8d4a-521fdb08a0be service neutron] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:21.888679 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00256de4-cfe1-4167-8d4a-521fdb08a0be service neutron] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:21.899202 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa95b1-b313-42e0-a088-cf9475266d43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '852fb6ed2a764a7db2c2497980c2e06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:21.900876 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa95b1-b313-42e0-a088-cf9475266d43 service placement] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:21.901364 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa95b1-b313-42e0-a088-cf9475266d43 service placement] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:21.901657 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa95b1-b313-42e0-a088-cf9475266d43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:21.905550 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-98fa95b1-b313-42e0-a088-cf9475266d43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:21.921481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa95b1-b313-42e0-a088-cf9475266d43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:21.928167 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa95b1-b313-42e0-a088-cf9475266d43 service placement] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:21.956159 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 604/1211] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:09:21 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:09:31.848434 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=97 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:09:31.938211 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=9 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:09:32.047371 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7290f-494c-4698-ac84-90a94db9f802 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:32.047663 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7290f-494c-4698-ac84-90a94db9f802 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:32.047944 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b7290f-494c-4698-ac84-90a94db9f802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:32.071467 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-d8b7290f-494c-4698-ac84-90a94db9f802 None None] MFA Rules not processed for user `e0eaeb03cb5f487f9640938b244fe210`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:32.073113 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-d8b7290f-494c-4698-ac84-90a94db9f802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:32.081068 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 608/1212] 10.222.0.57 () {58 vars in 1015 bytes} [Wed May 25 08:09:32 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:32.094849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa95b1-b313-42e0-a088-cf9475266d43 service placement] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:32.105946 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa95b1-b313-42e0-a088-cf9475266d43 service placement] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:32.111266 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bd9f7-3859-480c-bd24-8f9cdc09e232 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:32.112249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bd9f7-3859-480c-bd24-8f9cdc09e232 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:32.112617 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bd9f7-3859-480c-bd24-8f9cdc09e232 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:32.113053 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bd9f7-3859-480c-bd24-8f9cdc09e232 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:32.122633 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bd9f7-3859-480c-bd24-8f9cdc09e232 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:32.125255 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bd9f7-3859-480c-bd24-8f9cdc09e232 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:32.135277 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 605/1213] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:09:32 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:09:33.049222 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeaec6-7f8b-4a58-8b3e-bc26973fe9df None None] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:33.050705 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeaec6-7f8b-4a58-8b3e-bc26973fe9df None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:33.051607 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebeaec6-7f8b-4a58-8b3e-bc26973fe9df None None] PATH_INFO: `/` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:33.054914 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 609/1214] 10.222.0.25 () {54 vars in 921 bytes} [Wed May 25 08:09:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:09:33.104346 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ab954-6323-4bf0-8243-5ed0bac1416c None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:33.104868 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ab954-6323-4bf0-8243-5ed0bac1416c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:33.104975 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1ab954-6323-4bf0-8243-5ed0bac1416c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:33.124698 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-8f1ab954-6323-4bf0-8243-5ed0bac1416c None None] MFA Rules not processed for user `0b9bc11432e04e779fffd35473e6fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:33.125782 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8f1ab954-6323-4bf0-8243-5ed0bac1416c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:33.140379 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 606/1215] 10.222.0.25 () {58 vars in 1018 bytes} [Wed May 25 08:09:33 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 25 08:09:33.156670 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeaec6-7f8b-4a58-8b3e-bc26973fe9df None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:33.180417 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebeaec6-7f8b-4a58-8b3e-bc26973fe9df None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:33.188342 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3cc954-3ef5-4e47-9f85-a3f268354578 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:33.189579 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cc954-3ef5-4e47-9f85-a3f268354578 service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:33.190116 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cc954-3ef5-4e47-9f85-a3f268354578 service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:33.190595 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3cc954-3ef5-4e47-9f85-a3f268354578 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:33.204851 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cc954-3ef5-4e47-9f85-a3f268354578 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:33.210551 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3cc954-3ef5-4e47-9f85-a3f268354578 service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:33.224302 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 610/1216] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:09:33 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:09:39.251440 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ca05f-6b23-4027-9350-edd46800fd36 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:39.252064 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ca05f-6b23-4027-9350-edd46800fd36 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:39.252064 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137ca05f-6b23-4027-9350-edd46800fd36 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:39.253686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 607/1217] 10.222.0.25 () {54 vars in 921 bytes} [Wed May 25 08:09:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:09:39.267613 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eddae-3970-4636-bd0e-7acfea7a03d6 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:39.268615 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eddae-3970-4636-bd0e-7acfea7a03d6 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:39.268615 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304eddae-3970-4636-bd0e-7acfea7a03d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:39.289852 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-304eddae-3970-4636-bd0e-7acfea7a03d6 None None] MFA Rules not processed for user `0b9bc11432e04e779fffd35473e6fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:39.291093 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-304eddae-3970-4636-bd0e-7acfea7a03d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:39.300996 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 611/1218] 10.222.0.25 () {58 vars in 1018 bytes} [Wed May 25 08:09:39 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:39.315535 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ca05f-6b23-4027-9350-edd46800fd36 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:39.331496 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137ca05f-6b23-4027-9350-edd46800fd36 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:39.338480 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a35b5-87aa-4257-ae15-6cdb04f4577f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:39.339034 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a35b5-87aa-4257-ae15-6cdb04f4577f service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:39.339320 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a35b5-87aa-4257-ae15-6cdb04f4577f service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:39.339599 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a35b5-87aa-4257-ae15-6cdb04f4577f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:39.349777 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a35b5-87aa-4257-ae15-6cdb04f4577f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:39.351692 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95a35b5-87aa-4257-ae15-6cdb04f4577f service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:39.362746 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 608/1219] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:09:39 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:09:49.283721 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=12 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:09:49.358182 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=15 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:09:49.815943 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eddae-3970-4636-bd0e-7acfea7a03d6 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:49.825312 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304eddae-3970-4636-bd0e-7acfea7a03d6 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:49.829106 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ff9a0-d8b5-46c5-ad9d-a5a1ee057b40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:49.829776 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ff9a0-d8b5-46c5-ad9d-a5a1ee057b40 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:49.830099 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ff9a0-d8b5-46c5-ad9d-a5a1ee057b40 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:49.830415 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ff9a0-d8b5-46c5-ad9d-a5a1ee057b40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:49.839857 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ff9a0-d8b5-46c5-ad9d-a5a1ee057b40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:49.841920 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ff9a0-d8b5-46c5-ad9d-a5a1ee057b40 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:49.851889 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 612/1220] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:09:49 2022] GET /identity/v3/auth/tokens => generated 2879 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:09:53.893062 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32436-5c62-4ea6-85a2-96f982a51f88 None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:53.893655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32436-5c62-4ea6-85a2-96f982a51f88 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:53.893655 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b32436-5c62-4ea6-85a2-96f982a51f88 None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:53.895763 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 609/1221] 10.222.0.25 () {54 vars in 921 bytes} [Wed May 25 08:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:09:53.901406 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb6212-b2f1-4c1b-ba11-3c5d357659b5 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:53.901982 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb6212-b2f1-4c1b-ba11-3c5d357659b5 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:53.902182 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb6212-b2f1-4c1b-ba11-3c5d357659b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:53.945079 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-59bb6212-b2f1-4c1b-ba11-3c5d357659b5 None None] MFA Rules not processed for user `0b9bc11432e04e779fffd35473e6fbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:09:53.946423 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-59bb6212-b2f1-4c1b-ba11-3c5d357659b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:09:53.965329 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 613/1222] 10.222.0.25 () {58 vars in 1018 bytes} [Wed May 25 08:09:53 2022] POST /identity/v3/auth/tokens => generated 2853 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:09:54.102481 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32436-5c62-4ea6-85a2-96f982a51f88 None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:09:54.122061 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b32436-5c62-4ea6-85a2-96f982a51f88 None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:09:54.129534 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124e132-2db3-4acd-af27-fc154eb29f5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:09:54.130504 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e132-2db3-4acd-af27-fc154eb29f5f service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:09:54.130875 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e132-2db3-4acd-af27-fc154eb29f5f service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:09:54.131372 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124e132-2db3-4acd-af27-fc154eb29f5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:09:54.144770 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124e132-2db3-4acd-af27-fc154eb29f5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:09:54.149824 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124e132-2db3-4acd-af27-fc154eb29f5f service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:09:54.165435 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 610/1223] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:09:54 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:10:03.929144 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=9 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:10:04.158545 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=6 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:10:11.774946 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825d7c-3be1-435a-85f1-d29212d81847 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:10:11.775571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825d7c-3be1-435a-85f1-d29212d81847 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:10:11.775571 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d825d7c-3be1-435a-85f1-d29212d81847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:10:11.794185 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-9d825d7c-3be1-435a-85f1-d29212d81847 None None] MFA Rules not processed for user `df6b69c051754b5c9f3002336d1f5c24`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:10:11.795398 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-9d825d7c-3be1-435a-85f1-d29212d81847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:10:11.802402 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 614/1224] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:10:11 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:10:12.128629 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b6be1-f1b5-4b82-8dee-36a62bec8a96 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:10:12.129212 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b6be1-f1b5-4b82-8dee-36a62bec8a96 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:10:12.129212 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b6be1-f1b5-4b82-8dee-36a62bec8a96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:10:12.148047 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-239b6be1-f1b5-4b82-8dee-36a62bec8a96 None None] MFA Rules not processed for user `e0eaeb03cb5f487f9640938b244fe210`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:10:12.149339 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-239b6be1-f1b5-4b82-8dee-36a62bec8a96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:10:12.156542 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 611/1225] 10.222.0.25 () {58 vars in 1009 bytes} [Wed May 25 08:10:12 2022] POST /identity/v3/auth/tokens => generated 2671 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:10:12.167674 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825d7c-3be1-435a-85f1-d29212d81847 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:10:12.177753 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d825d7c-3be1-435a-85f1-d29212d81847 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:10:12.181305 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe0dbdb-63ed-481f-bcd6-55535b4ce405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:10:12.181975 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0dbdb-63ed-481f-bcd6-55535b4ce405 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:10:12.182260 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0dbdb-63ed-481f-bcd6-55535b4ce405 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:10:12.182540 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe0dbdb-63ed-481f-bcd6-55535b4ce405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:10:12.190960 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0dbdb-63ed-481f-bcd6-55535b4ce405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:10:12.192559 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe0dbdb-63ed-481f-bcd6-55535b4ce405 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:10:12.202066 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 615/1226] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:10:12 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:10:22.142640 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:10:22.197972 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=9 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:10:38.419436 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4354497-96d7-4f0c-b4d2-bd854af8bcb9 None None] REQUEST_METHOD: `POST` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:10:38.420301 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4354497-96d7-4f0c-b4d2-bd854af8bcb9 None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:10:38.420301 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4354497-96d7-4f0c-b4d2-bd854af8bcb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:10:38.440717 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.auth.core [None req-a4354497-96d7-4f0c-b4d2-bd854af8bcb9 None None] MFA Rules not processed for user `df6b69c051754b5c9f3002336d1f5c24`. Rule list: `[]` (Enabled: `True`). {{(pid=87085) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:10:38.442069 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a4354497-96d7-4f0c-b4d2-bd854af8bcb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:10:38.450471 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 612/1227] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:10:38 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:10:48.433314 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=3 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:10:50.387141 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cf9a2-904c-4856-9474-2dcef2e5a5e2 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:10:50.387673 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cf9a2-904c-4856-9474-2dcef2e5a5e2 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:10:50.387764 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826cf9a2-904c-4856-9474-2dcef2e5a5e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:10:50.405308 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-826cf9a2-904c-4856-9474-2dcef2e5a5e2 None None] MFA Rules not processed for user `df6b69c051754b5c9f3002336d1f5c24`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:10:50.406528 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-826cf9a2-904c-4856-9474-2dcef2e5a5e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:10:50.415011 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 616/1228] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:10:50 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:11:00.399931 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=3 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:11:27.188575 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bcc84-2de7-45d3-8388-3eb25b3e5f8c None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:11:27.189138 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bcc84-2de7-45d3-8388-3eb25b3e5f8c None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:11:27.189138 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0bcc84-2de7-45d3-8388-3eb25b3e5f8c None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:11:27.191064 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 613/1229] 10.222.0.25 () {54 vars in 921 bytes} [Wed May 25 08:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:11:27.209943 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8e64c-79a4-498f-9b2c-7cb2ddb740cf None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:11:27.210947 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8e64c-79a4-498f-9b2c-7cb2ddb740cf None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:11:27.211269 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b8e64c-79a4-498f-9b2c-7cb2ddb740cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:11:27.263905 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-25b8e64c-79a4-498f-9b2c-7cb2ddb740cf None None] MFA Rules not processed for user `852fb6ed2a764a7db2c2497980c2e06f`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:11:27.265524 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-25b8e64c-79a4-498f-9b2c-7cb2ddb740cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:11:27.276071 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 617/1230] 10.222.0.25 () {58 vars in 1018 bytes} [Wed May 25 08:11:27 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:11:27.302380 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bcc84-2de7-45d3-8388-3eb25b3e5f8c None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:11:27.320694 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0bcc84-2de7-45d3-8388-3eb25b3e5f8c None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:11:27.327415 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267a359-a3b3-487c-b018-ae4028e1175a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '852fb6ed2a764a7db2c2497980c2e06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:11:27.328394 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267a359-a3b3-487c-b018-ae4028e1175a service placement] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:11:27.329043 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267a359-a3b3-487c-b018-ae4028e1175a service placement] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:11:27.329200 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c267a359-a3b3-487c-b018-ae4028e1175a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:11:27.339774 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267a359-a3b3-487c-b018-ae4028e1175a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:11:27.341874 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c267a359-a3b3-487c-b018-ae4028e1175a service placement] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:11:27.353762 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 614/1231] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:11:27 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:11:31.157964 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8e64c-79a4-498f-9b2c-7cb2ddb740cf None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:11:31.310246 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b8e64c-79a4-498f-9b2c-7cb2ddb740cf None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:11:31.317515 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:11:31.318589 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:11:31.318985 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:11:31.319563 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] PATH_INFO: `/v3/users/d7722d00511543f89c57fd9bcf82e0b9` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:11:31.321058 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7722d00511543f89c57fd9bcf82e0b9)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:11:31.323211 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:11:31.391207 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7722d00511543f89c57fd9bcf82e0b9'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:31.391900 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7722d00511543f89c57fd9bcf82e0b9'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:31.401918 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7722d00511543f89c57fd9bcf82e0b9'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:31.418290 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7722d00511543f89c57fd9bcf82e0b9'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:31.419129 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7722d00511543f89c57fd9bcf82e0b9'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:31.439943 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 618/1232] 10.222.0.25 () {58 vars in 1223 bytes} [Wed May 25 08:11:31 2022] DELETE /identity/v3/users/d7722d00511543f89c57fd9bcf82e0b9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 08:11:31.654275 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267a359-a3b3-487c-b018-ae4028e1175a service placement] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:11:31.667475 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c267a359-a3b3-487c-b018-ae4028e1175a service placement] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:11:31.736231 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:11:31.737200 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:11:31.737555 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:11:31.737870 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] PATH_INFO: `/v3/projects/0487f430a6974b6f9ba737f3542fc1f0` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:11:31.739206 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0487f430a6974b6f9ba737f3542fc1f0)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:11:31.741455 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:11:31.795763 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0487f430a6974b6f9ba737f3542fc1f0', 'request_id': 'req-a6353514-9840-4969-9cec-d0a3e3ccbccb'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:31.802714 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0487f430a6974b6f9ba737f3542fc1f0', 'request_id': 'req-a6353514-9840-4969-9cec-d0a3e3ccbccb'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:31.809849 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0487f430a6974b6f9ba737f3542fc1f0', 'request_id': 'req-a6353514-9840-4969-9cec-d0a3e3ccbccb'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:31.825423 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] The token cache is being invalidate because project 0487f430a6974b6f9ba737f3542fc1f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 08:11:31.825715 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:31.826412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:31.828226 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 615/1233] 10.222.0.25 () {58 vars in 1232 bytes} [Wed May 25 08:11:31 2022] DELETE /identity/v3/projects/0487f430a6974b6f9ba737f3542fc1f0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 25 08:11:31.833281 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:11:31.835653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:11:31.851419 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baf2884-9cba-49c5-b1fe-f0d64bbd4a21 admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:11:31.907923 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:11:31.918556 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61fb7e6-6bb0-4368-8fdc-463d0fc739b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:11:31.919514 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fb7e6-6bb0-4368-8fdc-463d0fc739b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:11:31.919804 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fb7e6-6bb0-4368-8fdc-463d0fc739b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:11:31.920498 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61fb7e6-6bb0-4368-8fdc-463d0fc739b2 admin admin] PATH_INFO: `/v3/users/3dad674870854344a961a8f21f6ceaa3` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:11:31.922053 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fb7e6-6bb0-4368-8fdc-463d0fc739b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dad674870854344a961a8f21f6ceaa3)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:11:31.924491 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61fb7e6-6bb0-4368-8fdc-463d0fc739b2 admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:11:31.989962 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-a61fb7e6-6bb0-4368-8fdc-463d0fc739b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dad674870854344a961a8f21f6ceaa3'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:31.991227 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-a61fb7e6-6bb0-4368-8fdc-463d0fc739b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dad674870854344a961a8f21f6ceaa3'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:31.999154 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-a61fb7e6-6bb0-4368-8fdc-463d0fc739b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dad674870854344a961a8f21f6ceaa3'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:32.013718 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-a61fb7e6-6bb0-4368-8fdc-463d0fc739b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dad674870854344a961a8f21f6ceaa3'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:32.014715 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-a61fb7e6-6bb0-4368-8fdc-463d0fc739b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dad674870854344a961a8f21f6ceaa3'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:32.030258 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 619/1234] 10.222.0.25 () {58 vars in 1223 bytes} [Wed May 25 08:11:31 2022] DELETE /identity/v3/users/3dad674870854344a961a8f21f6ceaa3 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 08:11:32.288072 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:11:32.290972 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:11:32.319498 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6353514-9840-4969-9cec-d0a3e3ccbccb admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:11:32.400594 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:11:32.401560 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:11:32.402425 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:11:32.402753 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] PATH_INFO: `/v3/projects/8dff53657d084d2e9adcd18355d39731` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:11:32.404564 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dff53657d084d2e9adcd18355d39731)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:11:32.407411 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:11:32.435179 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:11:32.474026 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dff53657d084d2e9adcd18355d39731', 'request_id': 'req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:32.482002 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dff53657d084d2e9adcd18355d39731', 'request_id': 'req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:32.490374 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dff53657d084d2e9adcd18355d39731', 'request_id': 'req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:32.512503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] The token cache is being invalidate because project 8dff53657d084d2e9adcd18355d39731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87085) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 08:11:32.513088 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:32.514194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:11:32.516606 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 616/1235] 10.222.0.25 () {58 vars in 1232 bytes} [Wed May 25 08:11:32 2022] DELETE /identity/v3/projects/8dff53657d084d2e9adcd18355d39731 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 08:11:42.024995 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=28,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:11:42.506876 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:11:48.986105 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58ce88-9104-4964-98db-ffe6fdf62a35 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:11:48.986649 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58ce88-9104-4964-98db-ffe6fdf62a35 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:11:48.986649 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a58ce88-9104-4964-98db-ffe6fdf62a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:11:49.005891 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-5a58ce88-9104-4964-98db-ffe6fdf62a35 None None] MFA Rules not processed for user `df6b69c051754b5c9f3002336d1f5c24`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:11:49.007175 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-5a58ce88-9104-4964-98db-ffe6fdf62a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:11:49.061101 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 620/1236] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:11:48 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:11:59.054229 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=25 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:12:00.939532 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:12:00.940999 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:12:01.010831 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbb513f-e36c-4634-8d72-b47b2f5f84e7 admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:12:01.015069 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d18be0-bdbb-4b8c-9bb8-1d56fc790fff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:12:01.015735 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d18be0-bdbb-4b8c-9bb8-1d56fc790fff service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:12:01.016015 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d18be0-bdbb-4b8c-9bb8-1d56fc790fff service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:12:01.016983 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d18be0-bdbb-4b8c-9bb8-1d56fc790fff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:12:01.018819 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-60d18be0-bdbb-4b8c-9bb8-1d56fc790fff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:12:01.086769 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d18be0-bdbb-4b8c-9bb8-1d56fc790fff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:12:01.088249 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d18be0-bdbb-4b8c-9bb8-1d56fc790fff service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:12:01.098062 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 617/1237] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:12:00 2022] GET /identity/v3/auth/tokens => generated 2873 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:12:11.093674 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=54 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:13:20.914919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58ce88-9104-4964-98db-ffe6fdf62a35 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:13:20.916334 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-5a58ce88-9104-4964-98db-ffe6fdf62a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:13:20.998097 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a58ce88-9104-4964-98db-ffe6fdf62a35 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:13:21.003846 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9a2016-6171-4780-8bd4-28c9b8871ad0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '852fb6ed2a764a7db2c2497980c2e06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:13:21.004530 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a2016-6171-4780-8bd4-28c9b8871ad0 service placement] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:13:21.004820 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a2016-6171-4780-8bd4-28c9b8871ad0 service placement] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:13:21.005097 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9a2016-6171-4780-8bd4-28c9b8871ad0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:13:21.006885 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-ec9a2016-6171-4780-8bd4-28c9b8871ad0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:13:21.019208 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a2016-6171-4780-8bd4-28c9b8871ad0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:13:21.020582 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9a2016-6171-4780-8bd4-28c9b8871ad0 service placement] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:13:21.031017 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 621/1238] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:13:20 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:13:31.026719 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=36 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:14:12.186742 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d18be0-bdbb-4b8c-9bb8-1d56fc790fff service neutron] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:14:12.188918 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-60d18be0-bdbb-4b8c-9bb8-1d56fc790fff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:14:12.274928 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d18be0-bdbb-4b8c-9bb8-1d56fc790fff service neutron] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:14:12.279584 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9c685-c892-4618-8b8e-99a1d3ed1d0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '051dfda2a77e4648ae1f5ee47296499d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:14:12.279584 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9c685-c892-4618-8b8e-99a1d3ed1d0d service cinder] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:14:12.279912 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9c685-c892-4618-8b8e-99a1d3ed1d0d service cinder] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:14:12.280200 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca9c685-c892-4618-8b8e-99a1d3ed1d0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:14:12.282270 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8ca9c685-c892-4618-8b8e-99a1d3ed1d0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:14:12.294319 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9c685-c892-4618-8b8e-99a1d3ed1d0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:14:12.297294 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca9c685-c892-4618-8b8e-99a1d3ed1d0d service cinder] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:14:12.308502 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 618/1239] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:14:12 2022] GET /identity/v3/auth/tokens => generated 2804 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:14:13.981763 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad51ba0-a755-4b37-9bd4-00661c5f530e None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:14:13.982355 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad51ba0-a755-4b37-9bd4-00661c5f530e None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:14:13.982498 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad51ba0-a755-4b37-9bd4-00661c5f530e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:14:14.001758 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-3ad51ba0-a755-4b37-9bd4-00661c5f530e None None] MFA Rules not processed for user `df6b69c051754b5c9f3002336d1f5c24`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:14:14.002976 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-3ad51ba0-a755-4b37-9bd4-00661c5f530e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:14:14.010224 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 622/1240] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:14:13 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:14:20.820741 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9c685-c892-4618-8b8e-99a1d3ed1d0d service cinder] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:14:20.822194 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8ca9c685-c892-4618-8b8e-99a1d3ed1d0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:14:20.835438 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca9c685-c892-4618-8b8e-99a1d3ed1d0d service cinder] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:14:20.839094 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a220be-eda0-4e2c-9689-05b42645d035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:14:20.839752 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a220be-eda0-4e2c-9689-05b42645d035 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:14:20.840042 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a220be-eda0-4e2c-9689-05b42645d035 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:14:20.840349 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a220be-eda0-4e2c-9689-05b42645d035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:14:20.842183 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-63a220be-eda0-4e2c-9689-05b42645d035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:14:20.932133 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a220be-eda0-4e2c-9689-05b42645d035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:14:20.933524 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a220be-eda0-4e2c-9689-05b42645d035 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:14:20.961022 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 619/1241] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:14:20 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:14:22.181729 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad51ba0-a755-4b37-9bd4-00661c5f530e None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:14:22.192657 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad51ba0-a755-4b37-9bd4-00661c5f530e None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:14:22.196265 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4c192e-1c65-4210-8649-f4c8e7aa3700 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:14:22.196919 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c192e-1c65-4210-8649-f4c8e7aa3700 service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:14:22.197201 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c192e-1c65-4210-8649-f4c8e7aa3700 service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:14:22.197484 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4c192e-1c65-4210-8649-f4c8e7aa3700 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:14:22.199479 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-cc4c192e-1c65-4210-8649-f4c8e7aa3700 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:14:22.212721 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c192e-1c65-4210-8649-f4c8e7aa3700 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:14:22.214169 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4c192e-1c65-4210-8649-f4c8e7aa3700 service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:14:22.224922 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 623/1242] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:14:22 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:14:30.958103 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=66 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:14:32.220291 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=9 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:15:21.900695 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a220be-eda0-4e2c-9689-05b42645d035 service neutron] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:15:21.911920 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a220be-eda0-4e2c-9689-05b42645d035 service neutron] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:15:21.916633 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685907-f8d4-4899-880c-847cf8be79f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:15:21.917432 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685907-f8d4-4899-880c-847cf8be79f2 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:15:21.917690 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685907-f8d4-4899-880c-847cf8be79f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:15:21.918000 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05685907-f8d4-4899-880c-847cf8be79f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:15:21.920007 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-05685907-f8d4-4899-880c-847cf8be79f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:15:21.930323 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05685907-f8d4-4899-880c-847cf8be79f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:15:21.931748 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05685907-f8d4-4899-880c-847cf8be79f2 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:15:21.941385 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 620/1243] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:15:21 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:15:31.937316 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=6 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:16:17.940259 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79f37-3d37-4745-ad5d-9e4d7cf97bb8 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:16:17.942414 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79f37-3d37-4745-ad5d-9e4d7cf97bb8 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:16:17.942414 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c79f37-3d37-4745-ad5d-9e4d7cf97bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:16:17.969453 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-41c79f37-3d37-4745-ad5d-9e4d7cf97bb8 None None] MFA Rules not processed for user `df6b69c051754b5c9f3002336d1f5c24`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:16:17.970670 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-41c79f37-3d37-4745-ad5d-9e4d7cf97bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:16:17.999034 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 624/1244] 10.222.0.25 () {58 vars in 957 bytes} [Wed May 25 08:16:17 2022] POST /identity/v3/auth/tokens => generated 2804 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:16:18.358612 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685907-f8d4-4899-880c-847cf8be79f2 service neutron] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:16:18.377460 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05685907-f8d4-4899-880c-847cf8be79f2 service neutron] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:16:18.381504 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5425f02-c01c-4e18-ba3e-c8da34bfd187 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:16:18.382161 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5425f02-c01c-4e18-ba3e-c8da34bfd187 service neutron] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:16:18.382447 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5425f02-c01c-4e18-ba3e-c8da34bfd187 service neutron] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:16:18.382724 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5425f02-c01c-4e18-ba3e-c8da34bfd187 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:16:18.384558 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e5425f02-c01c-4e18-ba3e-c8da34bfd187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:16:18.408904 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5425f02-c01c-4e18-ba3e-c8da34bfd187 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:16:18.410273 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5425f02-c01c-4e18-ba3e-c8da34bfd187 service neutron] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:16:18.418463 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 621/1245] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:16:18 2022] GET /identity/v3/auth/tokens => generated 2671 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:16:18.913744 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c79f37-3d37-4745-ad5d-9e4d7cf97bb8 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:16:18.948279 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c79f37-3d37-4745-ad5d-9e4d7cf97bb8 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:16:18.957361 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c7097-4a56-4a04-86f6-745baef6c4d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '852fb6ed2a764a7db2c2497980c2e06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:16:18.958159 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c7097-4a56-4a04-86f6-745baef6c4d0 service placement] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:16:18.958448 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c7097-4a56-4a04-86f6-745baef6c4d0 service placement] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:16:18.958737 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3c7097-4a56-4a04-86f6-745baef6c4d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:16:18.960881 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-6a3c7097-4a56-4a04-86f6-745baef6c4d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:16:18.974710 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c7097-4a56-4a04-86f6-745baef6c4d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:16:18.976378 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3c7097-4a56-4a04-86f6-745baef6c4d0 service placement] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:16:18.988306 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 625/1246] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:16:18 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 76 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:16:21.479125 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5425f02-c01c-4e18-ba3e-c8da34bfd187 service neutron] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:16:21.481174 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-e5425f02-c01c-4e18-ba3e-c8da34bfd187 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:16:21.498894 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5425f02-c01c-4e18-ba3e-c8da34bfd187 service neutron] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:16:21.504082 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6baedf-832e-4348-84ec-3bf6f097f273 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:16:21.504773 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6baedf-832e-4348-84ec-3bf6f097f273 service nova] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:16:21.505059 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6baedf-832e-4348-84ec-3bf6f097f273 service nova] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:16:21.505603 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6baedf-832e-4348-84ec-3bf6f097f273 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:16:21.507526 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-df6baedf-832e-4348-84ec-3bf6f097f273 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:16:21.521533 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6baedf-832e-4348-84ec-3bf6f097f273 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:16:21.523502 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6baedf-832e-4348-84ec-3bf6f097f273 service nova] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:16:21.536901 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 622/1247] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:16:21 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:16:27.258414 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c7097-4a56-4a04-86f6-745baef6c4d0 service placement] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:16:27.270829 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3c7097-4a56-4a04-86f6-745baef6c4d0 service placement] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:16:27.276754 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11331-365f-41cd-aeb5-fb1da26ad644 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0b9bc11432e04e779fffd35473e6fbfa', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:16:27.278121 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11331-365f-41cd-aeb5-fb1da26ad644 service nova] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:16:27.278504 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11331-365f-41cd-aeb5-fb1da26ad644 service nova] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:16:27.278875 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a11331-365f-41cd-aeb5-fb1da26ad644 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:16:27.280843 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-23a11331-365f-41cd-aeb5-fb1da26ad644 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:16:27.294181 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a11331-365f-41cd-aeb5-fb1da26ad644 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:16:27.296679 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a11331-365f-41cd-aeb5-fb1da26ad644 service nova] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:16:27.313580 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 626/1248] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:16:27 2022] GET /identity/v3/auth/tokens => generated 2853 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:16:31.531287 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=21 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:16:37.308653 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=30 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:18:24.192393 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6baedf-832e-4348-84ec-3bf6f097f273 service nova] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:18:24.203403 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6baedf-832e-4348-84ec-3bf6f097f273 service nova] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:18:24.210145 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d255de8d-3679-412b-8ab2-8bead0e1d891 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '852fb6ed2a764a7db2c2497980c2e06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:18:24.210850 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255de8d-3679-412b-8ab2-8bead0e1d891 service placement] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:18:24.211355 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255de8d-3679-412b-8ab2-8bead0e1d891 service placement] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:18:24.211686 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d255de8d-3679-412b-8ab2-8bead0e1d891 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:18:24.220959 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255de8d-3679-412b-8ab2-8bead0e1d891 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:18:24.222756 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d255de8d-3679-412b-8ab2-8bead0e1d891 service placement] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:18:24.233433 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 623/1249] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:18:24 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:18:34.229412 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=6 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:19:08.529752 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11331-365f-41cd-aeb5-fb1da26ad644 service nova] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:19:08.539048 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a11331-365f-41cd-aeb5-fb1da26ad644 service nova] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:19:08.543074 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0ce77d-39e8-45ee-82e4-71e7e077c77d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e0eaeb03cb5f487f9640938b244fe210', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:19:08.543718 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ce77d-39e8-45ee-82e4-71e7e077c77d service neutron] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:19:08.544002 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ce77d-39e8-45ee-82e4-71e7e077c77d service neutron] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:19:08.544328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0ce77d-39e8-45ee-82e4-71e7e077c77d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:19:08.546161 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-7d0ce77d-39e8-45ee-82e4-71e7e077c77d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:19:08.632909 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ce77d-39e8-45ee-82e4-71e7e077c77d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:19:08.634349 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0ce77d-39e8-45ee-82e4-71e7e077c77d service neutron] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:19:08.643813 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 627/1250] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:19:08 2022] GET /identity/v3/auth/tokens => generated 2789 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:19:11.620983 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16b65e-8f53-48bd-adaa-ed54ef033aca None None] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:19:11.621437 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16b65e-8f53-48bd-adaa-ed54ef033aca None None] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:19:11.621606 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e16b65e-8f53-48bd-adaa-ed54ef033aca None None] PATH_INFO: `/` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:19:11.623257 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 624/1251] 10.222.0.25 () {54 vars in 921 bytes} [Wed May 25 08:19:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 25 08:19:11.632627 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a7e12-3fa4-4c29-b664-c506fd9a7b22 None None] REQUEST_METHOD: `POST` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:19:11.633172 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a7e12-3fa4-4c29-b664-c506fd9a7b22 None None] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:19:11.633172 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a7e12-3fa4-4c29-b664-c506fd9a7b22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:19:11.686397 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.auth.core [None req-334a7e12-3fa4-4c29-b664-c506fd9a7b22 None None] MFA Rules not processed for user `852fb6ed2a764a7db2c2497980c2e06f`. Rule list: `[]` (Enabled: `True`). {{(pid=87084) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 25 08:19:11.687439 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-334a7e12-3fa4-4c29-b664-c506fd9a7b22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:19:11.699698 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 628/1252] 10.222.0.25 () {58 vars in 1018 bytes} [Wed May 25 08:19:11 2022] POST /identity/v3/auth/tokens => generated 2858 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 25 08:19:11.711503 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16b65e-8f53-48bd-adaa-ed54ef033aca None None] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:19:11.713290 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-8e16b65e-8f53-48bd-adaa-ed54ef033aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:19:11.729731 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e16b65e-8f53-48bd-adaa-ed54ef033aca None None] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:19:11.734783 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb2604-b64a-4c7c-945d-078b9c83b695 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '852fb6ed2a764a7db2c2497980c2e06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:19:11.735433 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb2604-b64a-4c7c-945d-078b9c83b695 service placement] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:19:11.735720 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb2604-b64a-4c7c-945d-078b9c83b695 service placement] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:19:11.736001 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb2604-b64a-4c7c-945d-078b9c83b695 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:19:11.744480 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb2604-b64a-4c7c-945d-078b9c83b695 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:19:11.746063 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb2604-b64a-4c7c-945d-078b9c83b695 service placement] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:19:11.756431 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 625/1253] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:19:11 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:19:15.026077 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a7e12-3fa4-4c29-b664-c506fd9a7b22 None None] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:19:15.036673 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334a7e12-3fa4-4c29-b664-c506fd9a7b22 None None] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:19:15.041614 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a3b63-9382-4c96-bc26-80a318dbdb6b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '852fb6ed2a764a7db2c2497980c2e06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:19:15.042262 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3b63-9382-4c96-bc26-80a318dbdb6b service placement] REQUEST_METHOD: `GET` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:19:15.042545 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3b63-9382-4c96-bc26-80a318dbdb6b service placement] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:19:15.042848 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888a3b63-9382-4c96-bc26-80a318dbdb6b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:19:15.044627 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-888a3b63-9382-4c96-bc26-80a318dbdb6b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:19:15.056807 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a3b63-9382-4c96-bc26-80a318dbdb6b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:19:15.058401 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888a3b63-9382-4c96-bc26-80a318dbdb6b service placement] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:19:15.070587 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 629/1254] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:19:15 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:19:15.083071 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb2604-b64a-4c7c-945d-078b9c83b695 service placement] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:19:15.084776 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-59eb2604-b64a-4c7c-945d-078b9c83b695 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:19:15.100164 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb2604-b64a-4c7c-945d-078b9c83b695 service placement] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:19:15.105232 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:19:15.106055 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:19:15.106335 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:19:15.106610 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] PATH_INFO: `/v3/users/df6b69c051754b5c9f3002336d1f5c24` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:19:15.121888 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=df6b69c051754b5c9f3002336d1f5c24)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:19:15.122925 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: WARNING py.warnings [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 08:19:15.122925 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: warnings.warn(msg) May 25 08:19:15.122925 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: May 25 08:19:15.124171 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:19:15.185743 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df6b69c051754b5c9f3002336d1f5c24'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.186386 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df6b69c051754b5c9f3002336d1f5c24'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.197141 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df6b69c051754b5c9f3002336d1f5c24'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.216100 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df6b69c051754b5c9f3002336d1f5c24'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.216838 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df6b69c051754b5c9f3002336d1f5c24'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.229492 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 626/1255] 10.222.0.25 () {58 vars in 1223 bytes} [Wed May 25 08:19:15 2022] DELETE /identity/v3/users/df6b69c051754b5c9f3002336d1f5c24 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 08:19:15.402852 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a3b63-9382-4c96-bc26-80a318dbdb6b service placement] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:19:15.414899 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888a3b63-9382-4c96-bc26-80a318dbdb6b service placement] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:19:15.496723 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:19:15.497597 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:19:15.497880 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:19:15.498154 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] PATH_INFO: `/v3/projects/e3d0f983416a4b55bfb63f94fa5a3d38` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:19:15.509804 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3d0f983416a4b55bfb63f94fa5a3d38)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:19:15.510843 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: WARNING py.warnings [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 25 08:19:15.510843 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: warnings.warn(msg) May 25 08:19:15.510843 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: May 25 08:19:15.512114 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:19:15.546237 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:19:15.570153 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3d0f983416a4b55bfb63f94fa5a3d38', 'request_id': 'req-37166785-ee9f-454d-9cac-32feb7668e67'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.583432 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3d0f983416a4b55bfb63f94fa5a3d38', 'request_id': 'req-37166785-ee9f-454d-9cac-32feb7668e67'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.590167 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3d0f983416a4b55bfb63f94fa5a3d38', 'request_id': 'req-37166785-ee9f-454d-9cac-32feb7668e67'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.601955 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] The token cache is being invalidate because project e3d0f983416a4b55bfb63f94fa5a3d38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 08:19:15.602246 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.602862 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.604623 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 630/1256] 10.222.0.25 () {58 vars in 1232 bytes} [Wed May 25 08:19:15 2022] DELETE /identity/v3/projects/e3d0f983416a4b55bfb63f94fa5a3d38 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 08:19:15.608588 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:19:15.610016 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:19:15.622854 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf3190b-649c-4a74-b3db-34093ec96c2e admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:19:15.679598 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:19:15.680494 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:19:15.680776 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:19:15.681051 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] PATH_INFO: `/v3/users/fa30cf710be94787a4a5e5212205ad68` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:19:15.694117 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa30cf710be94787a4a5e5212205ad68)` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:19:15.696041 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:19:15.735081 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:19:15.743301 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa30cf710be94787a4a5e5212205ad68'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.744244 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa30cf710be94787a4a5e5212205ad68'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.751736 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa30cf710be94787a4a5e5212205ad68'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.764149 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa30cf710be94787a4a5e5212205ad68'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.764833 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.notifications [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa30cf710be94787a4a5e5212205ad68'} {{(pid=87085) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:15.777184 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 627/1257] 10.222.0.25 () {58 vars in 1223 bytes} [Wed May 25 08:19:15 2022] DELETE /identity/v3/users/fa30cf710be94787a4a5e5212205ad68 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 08:19:15.951832 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] Authenticating user token {{(pid=87084) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:19:15.953697 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.fernet_utils [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87084) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:19:15.968801 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37166785-ee9f-454d-9cac-32feb7668e67 admin admin] Validating token access rules against request {{(pid=87084) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:19:16.027379 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28fb544-57a2-4f37-886f-2d2239684153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '945bb5172fb64c3a9a54077b32240aed', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '93a049a9852946a29f77e99f63516cc1', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87084) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:19:16.028287 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fb544-57a2-4f37-886f-2d2239684153 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:19:16.028578 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fb544-57a2-4f37-886f-2d2239684153 admin admin] SCRIPT_NAME: `/identity` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:19:16.028863 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28fb544-57a2-4f37-886f-2d2239684153 admin admin] PATH_INFO: `/v3/projects/082af09e48744103b3650c73ad86d8e1` {{(pid=87084) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:19:16.039667 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fb544-57a2-4f37-886f-2d2239684153 admin admin] RBAC: Authorizing `identity:delete_project(project_id=082af09e48744103b3650c73ad86d8e1)` {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:19:16.041856 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28fb544-57a2-4f37-886f-2d2239684153 admin admin] RBAC: Authorization granted {{(pid=87084) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:19:16.087805 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-e28fb544-57a2-4f37-886f-2d2239684153 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '082af09e48744103b3650c73ad86d8e1', 'request_id': 'req-e28fb544-57a2-4f37-886f-2d2239684153'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:16.093864 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-e28fb544-57a2-4f37-886f-2d2239684153 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '082af09e48744103b3650c73ad86d8e1', 'request_id': 'req-e28fb544-57a2-4f37-886f-2d2239684153'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:16.099328 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-e28fb544-57a2-4f37-886f-2d2239684153 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '082af09e48744103b3650c73ad86d8e1', 'request_id': 'req-e28fb544-57a2-4f37-886f-2d2239684153'} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:16.111803 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-e28fb544-57a2-4f37-886f-2d2239684153 admin admin] The token cache is being invalidate because project 082af09e48744103b3650c73ad86d8e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87084) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 25 08:19:16.112143 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-e28fb544-57a2-4f37-886f-2d2239684153 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:16.112884 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG keystone.notifications [None req-e28fb544-57a2-4f37-886f-2d2239684153 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87084) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 25 08:19:16.114469 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: [pid: 87084|app: 0|req: 631/1258] 10.222.0.25 () {58 vars in 1232 bytes} [Wed May 25 08:19:15 2022] DELETE /identity/v3/projects/082af09e48744103b3650c73ad86d8e1 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 25 08:19:25.774474 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:DELETE=5,keystone:SELECT=14,keystone:INSERT=1 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:19:26.109402 dv-osbrick-830800-13-ceph devstack@keystone.service[87084]: DEBUG dbcounter [-] [87084] Writing DB stats keystone:DELETE=13,keystone:SELECT=69,keystone:INSERT=2 {{(pid=87084) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 08:23:32.173462 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] Authenticating user token {{(pid=87085) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 25 08:23:32.174927 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:23:32.264071 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c99551-8cee-4ca1-899a-90f6db2e15ca admin admin] Validating token access rules against request {{(pid=87085) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 25 08:23:32.324172 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce226df-e607-4c09-99a1-d298ffb737d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '852fb6ed2a764a7db2c2497980c2e06f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b056475a8e394bb3bae06f030dee95ab', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87085) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 25 08:23:32.324826 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce226df-e607-4c09-99a1-d298ffb737d7 service placement] REQUEST_METHOD: `GET` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 25 08:23:32.325109 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce226df-e607-4c09-99a1-d298ffb737d7 service placement] SCRIPT_NAME: `/identity` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 25 08:23:32.325385 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce226df-e607-4c09-99a1-d298ffb737d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87085) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 25 08:23:32.327263 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.fernet_utils [None req-2ce226df-e607-4c09-99a1-d298ffb737d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87085) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 25 08:23:32.338273 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce226df-e607-4c09-99a1-d298ffb737d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 25 08:23:32.339876 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce226df-e607-4c09-99a1-d298ffb737d7 service placement] RBAC: Authorization granted {{(pid=87085) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 25 08:23:32.349680 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: [pid: 87085|app: 0|req: 628/1259] 10.222.0.25 () {60 vars in 1365 bytes} [Wed May 25 08:23:32 2022] GET /identity/v3/auth/tokens => generated 2858 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 25 08:23:42.345650 dv-osbrick-830800-13-ceph devstack@keystone.service[87085]: DEBUG dbcounter [-] [87085] Writing DB stats keystone:SELECT=67 {{(pid=87085) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}